Purpose of Job:

We are seeking a highly motivated and skilled Data Engineer Intern to join our dynamic team. If you are passionate about data engineering, software development, and are looking for a challenging opportunity to make a significant impact, we want to hear from you.

As a Data Engineer Intern at Divergent Technologies, Inc. you will play a crucial role in designing, developing, and maintaining data pipelines and software solutions that enable efficient data collection, storage, and analysis. You will work closely with our data science and analytics teams to ensure that data is readily accessible and usable for a variety of purposes, including reporting, machine learning, and business intelligence. In this role, you will be responsible for data warehousing, data lakehouse management, and integrating with various services and applications.

Essential Job Functions and Performance Standards:

Design, develop, and maintain data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse and data lakehouse.

Optimize and fine-tune data pipelines for performance and scalability.

Implement data quality checks and monitoring to ensure data accuracy and integrity in both the data warehouse and data lakehouse.

Develop and maintain data integration tools and frameworks to enable seamless data access for various stakeholders.

Work on integrations with external services such as Jira, Splunk, Oracle, MES, ERP, and other third-party systems to facilitate data exchange and synchronization.

Lead the design and development of data engineering framework that meets the needs of our internal processes and clients.

Develop and maintain software development best practices to ensure high-quality code, efficient testing, and timely releases.

Collaborate with cross-functional teams to understand data requirements, translate them into software solutions, prioritize features, and ensure our data engineering solution integrates seamlessly with other software products.

Collaborate with data scientists and analysts to support their data needs and ensure data is readily available for analysis.

Continuously monitor industry data engineering and software development trends and incorporate new technologies and best practices into our software development process.

Education:

Bachelor’s or Master’s in computer science, mathematics, data science, data engineering, computational science, software engineering, or related fields.

Experience:

Proven experience in data engineering, ETL, and data pipeline development.

Strong knowledge of SQL and relational databases.

Previous professional or internship experience in software development and data engineering is a plus.

Strong knowledge of SQL and relational databases.

Familiarity with data warehousing concepts and tools (e.g., AWS Redshift, Google BigQuery, Snowflake, Microsoft Fabric) and data lakehouse architectures.

Solid understanding of data integration and data transformation techniques.

Experience with integrating with services like Jira, Splunk, Oracle, MES, ERP, and in-house web applications.

Skills:

Strong proficiency in programming languages such as Python, Java, C++ or Scala.

Familiarity with industry standards and regulations for data protection.

Deep understanding of software development processes and best practices.

Strong analytical and problem-solving skills, with the ability to identify and solve complex technical issues.

Strong project management skills and ability to manage multiple projects simultaneously.

Excellent communication and collaboration abilities.

Self-motivated with a passion for continuous learning and improvement.

Ability to work effectively with cross-functional teams, including business analysis, product management, engineering, and customer success.