Data Analytics Engineer: Become the Newest Member of the VF Family
We are looking for a Data/Analytics Engineer with hands on experience in Python and AWS Big Data technologies to help with ongoing development with Cloud Analytics team. The engineer will be working closely with Architecture, Engineering and business team members to develop and implement cutting edge solutions. Must have a very good understanding of Big Data Solution with a current experience as developer/engineer.
How You Will Make a Difference:
Main responsibility is to work side by side with the other team member to develop and deliver efficient big data solution. Understanding of agile methodology is a mandatory skill. The successful candidate will also partner closely with technical experts – including, but not limited to Architects – in defining reusable patterns, developing code standards/guidelines, and creating a review process that ensures quality across the development pipeline.
Evaluate and recommend key technology elements for Analytics platform
Collaborate with Solution Architects to ensure technical direction
Development of big data pipeline
Work on a team with other data engineer to release deliverables for the business
Participate in an Agile squad (scrum team)
Perform proof-of-concepts in new technologies.
Provide on-call production support as needed.
Educational/ Position Requirements:
Bachelor’s Degree in Computer Science, or equivalent education or equivalent experience required.
5+ years of overall software development experience with 3+ years in AWS cloud platform
Experience as a Software Engineer/Big Data Engineer
Familiarity with JIRA & Confluence or similar tracking and management tools
Excellent organizational, verbal and written communication and the ability to present information in a clear, concise and complete manner
Self-starter, creative, enthusiastic, innovative and collaborative attitude
Ability to prioritize tasks based on sense of urgency and accuracy
Strong team player with good communication & interpersonal skills.
Development and support of performant pipelines
Hands on experience on AWS serverless stack (Lambda, S3, API Gateway, SQS/SNS, CloudWatch
Consolidation of different sources of data (API, SQL Database, CSV, S3 and ftp files etc) into a centralized data store.
Agile development of Data Lake / Data Warehouse and ETL / EMR (Glue, Hadoop, Spark, YARN, HUE, REST APIs, HIVE).
Redshift and Big Query as data ware house system.
Experience with RDBMS (MySQL, Oracle) and SQL/DDL Language, and NoSQL (DynamoDB)
Development of message queue driven systems (Amazon SQS, SNS and Lambda based functions)
Development of streaming system (ie: Kinesis Stream, Kinesis Firehose)
Python development, PySpark development
Lambda development in Python, Node
Ability to perform code review and technical design review.