Data Engineer

Employment Type

: Full-Time

Industry

: Miscellaneous



Loading some great jobs for you...





Seeking a Data engineer for our direct client in Maplewood MN for 12 months contract role. Job title: IT configuration Engineer -DATA ENGINEER Location :Maplewood MN duration:12 months Job id:95606 Work authorization: Unable to sponsor, kindly candidates who doesn't need any kind of sponsorship to work need to apply. Open for non-locals who will relocate phone screen, tech round, skype/in person(depending on the candidate location) -must have development background(python preferred; will consider ETL/BI developers) -Python, Spark, kafka -experience in batch pipeline development -computer science degree -experience with database normalization -knowledge of AL & ML algorithms Primary Responsibilities: Be part of a core team research and adopting latest cloud based data technologies from end-to-end (data ingestion to consumption). Develop and maintain scalable data pipelines that will ingest, transform, and distribute numerous data streams and/or batches Develop and establish data management frameworks to prevent data lakes from becoming data swamps. Develop and maintain a CI/CD pipeline that manages and deploys data pipelines, data infrastructure and data artifacts as code. Advice, consult, mentor and coach client businesses, data scientists and data consumers / users on data standards, pipeline development, data storage, normalization and consumption. Basic Qualifications: Bachelor s degree or higher in a science or engineering discipline (completed and verified prior to start) from an accredited university Preferred Qualifications: One (1) or more years of professional experience as a data engineer, software engineer, data analyst or data scientist in a private, public, government or military environment Ability to work with many languages and frameworks including Python, C++, C#, Java, Javascript, Scala Hands on experience with relational SQL and NoSQL databases. Experience building data lakes and data warehouses in AWS and Azure Experience with cloud computing services and infrastructure in the data space (e.g. Azure ADLS, HD Insight, Databricks, AWS S3, AWS Glue, Elastic MapReduce, etc.) and awareness of considerations for building scalable, distributed systems. Experience with stream-processing systems: Amazon Kinesis, Azure Stream Analytics, Spark, Storm, Kafka etc. Experience with BI and reporting tools Strong problem-solving skills Ability to deal with the ambiguity of early-stage scouting and evaluation of new opportunities and the flexibility to change direction as additional information becomes available Leadership and networking skills Self-motivated and self-directed Excellent communication skills (oral, written and presentation) - provided by Dice

Launch your career - Create your profile now!

Create your Profile

Loading some great jobs for you...