Data Engineer- Python

Deloitte in San Diego, CA

  • Type: Full Time
position filled
As a Senior Consultant, you will focus on managing the information supply chain from acquisition to ingestion, storage and the provisioning of data to points of impact by modernizing and enabling new capabilities. Information value is enhanced through enterprise-scale applications that enable visualization, consumption and monetization of both structured and unstructured data. Big data is becoming one of the most important technology trends that has the potential for dramatically changing the way organizations use information to enhance the customer experience and transform their business models. **Work you'll do** Senior Consultants work within an engagement team. Key responsibilities will include: + Function as integrators between business needs and technology solutions, helping to create technology solutions to meet clients business needs. + Identifying business requirements, requirements management, functional design, prototyping, process design (including scenario design, flow mapping), testing, training, defining support procedures and supporting implementations. **The Team** Analytics & Cognitive In this age of disruption, organizations need to navigate the future with confidence, embracing decision making with clear, data-driven choices that deliver enterprise value in a dynamic business environment. The Analytics & Cognitive team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. Together with the Strategy practice, our Strategy & Analytics portfolio helps clients transform their business by architecting organizational intelligence programs and differentiated strategies to win in their chosen markets. Analytics & Cognitive will work with our clients to: + Implement large-scale data ecosystems including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms + Leverage automation, cognitive and science-based techniques to manage data, predict scenarios and prescribe actions + Drive operational efficiency by maintaining their data ecosystems, sourcing analytics expertise and providing As-a-Service offerings for continuous insights and improvements **Qualifications** **Required:** + 5 years of experience in core JAVA and SQL + 3 years of experience in Python & Unix Shell Scripting + 3 years of experience in building scalable and high performance data pipelines using Apache Hadoop, MapReduce, Pig & Hive + Experience with big data cross platform compatible file formats like Apache Avro & Apache Parquet + Experience in Apache Spark is a plus + 1 years of experience with data lake implementations, core modernizations and data ingestion + 1 years of hands on experience designing and implementing data ingestion techniques for real time and batch processes for video, voice, weblog, sensor, machine and social media data into Hadoop ecosystems and HDFS clusters. + 2 years of experience leading workstreams or small teams + Willingness for weekly client-based travel, up to 80-100% (Monday Thursday/Friday) + Bachelor s degree or equivalent professional experience **Preferred** + AWS Certification, Hadoop Certification or Spark Certification + Experience with Cloud using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP) + Experience with data integration products like Informatica Power Center Big Data Edition (BDE), IBM BigInsights, Talend etc. + Experience designing and implementing reporting and visualization for unstructured and structured data sets + Experience in designing and implementing scalable, distributed systems leveraging cloud computing technologies like AWS EC2, AWS Elastic MapReduce and Microsoft Azure + Experience designing and developing data cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching + Knowledge of data, master data and metadata related standards, processes and technology + Experience working with multi-terabyte data sets + Experience with data integration on traditional and Hadoop environments + Ability to work independently, manage small engagements or parts of large engagements. + Strong oral and written communication skills, including presentation skills (MS Visio, MS PowerPoint). + Strong problem solving and troubleshooting skills with the ability to exercise mature judgment. + Eagerness to mentor junior staff. + An advanced degree in the area of specialization is preferred. **How you ll grow** At Deloitte, our professional development plan focuses on helping people at every level of their career to identify and use their strengths to do their best work every day. From entry-level employees to senior leaders, we believe there s always room to learn. We offer opportunities to help sharpen skills in addition to hands-on experience in the global, fast-changing business world. From on-the-job learning experiences to formal development programs at Deloitte University, our professionals have a variety of opportunities to continue to grow throughout their career. Explore Deloitte University, The Leadership Center. at https://zoomforth.com/s/deloitte/du#home **Benefits** At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you. at http://www2.deloitte.com/us/en/pages/careers/articles/life-at-deloitte-benefits-and-rewards.html **Deloitte s culture** Our positive and supportive culture encourages our people to do their best work every day. We celebrate individuals by recognizing their uniqueness and offering them the flexibility to make daily choices that can help them to be healthy, centered, confident, and aware. We offer well-being programs and are continuously looking for new ways to maintain a culture where our people excel and lead healthy, happy lives. Learn more about Life at Deloitte. **Corporate citizenship** Deloitte is led by a purpose: to make an impact that matters. This purpose defines who we are and extends to relationships with our clients, our people and our communities. We believe that business has the power to inspire and transform. We focus on education, giving, skill-based volunteerism, and leadership to help drive positive social impact in our communities. Learn more about Deloitte s impact on the world. at http://www2.deloitte.com/us/en/pages/about-deloitte/articles/deloitte-corporate-citizenship.html **Recruiter tips** We want job seekers exploring opportunities at Deloitte to feel prepared and confident. To help you with your interview, we suggest that you do your research: know some background about the organization and the business area you re applying to. Check out recruiting tips from Deloitte professionals. at http://www2.deloitte.com/us/en/pages/careers/topics/recruiting-tips.html Category: Analytics About Deloitte As used in this document, Deloitte means Deloitte LLP and its subsidiaries. Please see www.deloitte.com/us/about for a detailed description of the legal structure of Deloitte LLP and its subsidiaries. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law. </script>

You may be interested in these similar jobs!
Low-voltage Technician
IES, LLC. in San Diego, CA

Direct Hire, with full benefits available Job Summary: The Communications Technician II must possess the ability to perform the technical responsibil…

Read More
AWS Data Engineer
Apolis in San Diego, CA

Title- AWS Data Engineer Location San Diego, CA Contract Job Description :- Position will work closely with the Scrum masters, Data Architects, QA, D…

Read More
Python Developer/PySpark Developer
Indecomm Digital Services in Carlsbad, CA

We are looking for a Python/Pyspark developer for our client based at @ Carlsbad, CA. The project is for about 12+ months. Please email your resume …

Read More
AWS Data Engineer in Playa Vista, CA/ San Diego CA
Stamford Technology Solutions LLC, DBA Infinity in San Diego, CA

Position : AWS Data Engineer Location : Playa Vista, CA/ San Diego, CA Job Description Experience on AWS and its web service offering S3, Redshift, …

Read More
AWS Data Engineer (Glue,Python,Spark)
Biztech Solutions in San Diego, CA

AWS Data Engineer (Glue,Python,Spark) San Diego CA Technical Skills: Mandatory Experience in AWS technologies such as EC2, Cloud formation, EMR Clust…

Read More
Sr. Systems Engineer - Applications - CA
Mitchell/Martin in San Diego, CA

Our client, a global pharmaceutical company, is seeking a Sr. Systems Engineer. Location: San Diego, CA Position Type: Contract Job scope: -Gather…

Read More
AWS Data Engineer (Glue,Python,Spark)
Aptask in San Diego, CA

Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc. Good knowledge…

Read More
Quality Assurance Engineer
Kaygen in Carlsbad, CA

Should have at least 8 years of experience as a QA in Enterprise Level Environment Create test plans & test cases for assigned features Design & buil…

Read More
Sr Data Engineer (National City)
Aroha Technologies in National City, CA

Job Description Our client is currently seeking a Sr.Data Engineer to work on-site in Menlo Park CA. This is a Contract job opportunity. For i…

Read More
Urgent requirement for Python Developer
Nityo Infotech in San Diego, CA

Hi, Greetings!! We have Urgent requirement for Python Developer at San Diego,CA. If you are available or have any consultant then please share update…

Read More
DevOps Engineer DIRECT HIRE OR CTH
Irvine Technology Corporation in Carlsbad, CA

NEW DevOps Engineer Direct Hire IMMEDIATE NEED for a DevOps Engineer for a DIRECT HIRE opportunity in Carlsbad, CA. We are seeking someone with exper…

Read More