Lead Data Engineer
Hays

The end client is unable to sponsor or transfer visas for this position; all parties authorized to work in the US without sponsorship are encouraged to apply.

Our Client is seeking a Lead Data Engineer in Atlanta, GA.

Role Description

The Lead Data Engineer is responsible for managing and organizing the company's enterprise data and overseeing the technical output of a team of data engineers. They will architect and design data pipelines and dictate how information should be managed, consolidated, and stored for optimal use by the organization. Lead Data Engineers will support other Data Engineers, Data Architects, and Data Analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They will drive standardization and reduce effort through automation.

• Lead a team of engineers through architecture, design, demand delivery, code reviews, release management, implementation, presentations, and meetings.
• Mentor fellow data engineers and contribute to ongoing process improvements for the team.
• Evaluate business needs and objectives and align architecture/designs with business requirements.
• Build the data pipelines required for the optimal extraction, transformation, integration, and loading of raw data from a wide variety of data sources.
• Assemble large, complex data sets and model our data in a way that meets functional / non-functional.
• Create data tools for analytics team members that assist them in generating innovative industry insights that provide our business a competitive advantage.
• Implement data tagging mechanisms and metadata management so data is accurately classified and visible to the organization.
• Build processes to help identify and improve data quality, consistency, and effectiveness.
• Ensure our data is managed in a way that conforms to all information privacy and protection policies.
• Use agile software development processes to iteratively make improvements to our data management systems.
• Identify opportunities for automation.
• Be an advocate for best practices and continued learning.

Skills & Requirements

• Prior experience with leading large scale implementation projects for enabling A2A and B2B integrations between on-premise and cloud applications.
• Prior experience with implementing integration solutions using publish/Subscribe and JMS based messaging patterns.
• JDBC, ODBC,etc in Java to database connectivity environments.
• GoAnywhere or Splunk.
• Bachelor's/Tech School degree in Computer Science, MIS, or Engineering or relevant technical field and/or commensurate years of real-world experience in software engineering.
• 7+ years of relevant experience in data management.
• 5+ years in data engineering with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT.
• 3+ years of experience with Cloud based DW such as Redshift, Snowflake, etc.
• Technical expertise with data models, data mining, and segmentation techniques.
• Experience in data acquisition, transformation, and storage design using design principles, patterns, and best practices.
• Experience with performance analysis and optimization.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift, Modern data platforms, Snowflake, dbt, Fivetran, and Airflow.
• Experience with stream-processing systems: Kafka, Storm, Spark-Streaming, etc. Data engineering certification is a plus.

Why Hays?

You will be working with a professional recruiter who has intimate knowledge of the industry and market trends. Your Hays recruiter will lead you through a thorough screening process in order to understand your skills, experience, needs, and drivers. You will also get support on resume writing, interview tips, and career planning, so when there's a position you really want, you're fully prepared to get it.

Nervous about an upcoming interview? Unsure how to write a new resume?

Visit the Hays Career Advice section to learn top tips to help you stand out from the crowd when job hunting.

Hays is an Equal Opportunity Employer including disability/veteran.

In accordance with applicable federal and state law protecting qualified individuals with known disabilities, Hays U.S. Corporation will attempt to reasonably accommodate those individuals unless doing so would create an undue hardship on the company. Any qualified applicant or consultant with a disability who requires an accommodation in order to perform the essential functions of the job should call or text 813.336.5570

Drug testing may be required; please contact a recruiter for more information. #1148264

This job has expired.