Senior Data Engineer
Titan Advanced Energy Solutions
Senior Data Engineer
Titan Advanced Energy Solutions, Inc., Salem, MA
Titan Advanced Energy Solutions (Titan) is developing and commercializing software to enhance the quality of manufacturing processes in energy production industries worldwide. We have combined sophisticated AI algorithms, software engineering and ultrasound cell-inspection technology to improves the quality of the lithium-ion battery cell and other energy or manufacturing quality applications. These world-class technological advances benefit the whole value chain, resulting in increased daily usable charge capacity, longer battery life, and improved safety monitoring and control.
Located in Salem, MA, Titan’s innovative strides have been recognized with numerous awards and funding from multi-national corporate investment groups, venture capital and top clean energy programs and institutions, including Greentown Labs, the Massachusetts Clean Energy Center (MassCEC) and the Department of Energy. Growing and poised to continue their positive momentum, this is an exciting time to join the Titan team!
We are looking for a Senior Data Engineer to join our exceptional team of world-class engineers.
Job Description:
The successful applicant will perform the following duties related to our software development.
Duties and Responsibilities:
- Implement, deploy, and maintain replication, ETL, and data validation pipelines that operate on TBs of ultrasound sensor data
- Write Python libraries that provide easier access to data and construction of pipelines to process data at scale
- Evaluate, deploy, and scale cloud native data management infrastructure including data storage and processing systems
- Write and maintain documentation on data storage and processing systems
- Collaborate with the broader Algorithms group to advise on use cases and create repeatable patterns for data processing pipelines that the team can implement to support modeling and analysis use cases
Required skills:
- 5+ years’ working experience engineering data intensive applications
- Expertise with Python in a production environment and workflow management frameworks like Airflow or Prefect
- Experience with AWS services, especially S3, CloudWatch, SQS
- Experience working with large amounts of data in a variety of formats, building automated validation and processing pipelines, supporting ML pipelines and applications
- Expertise with SQL, database design
Preferred skills:
- Experience with SageMaker or other MLOps tooling
- Experience with Docker
- Experience with big data processing tools like Apache Spark
Qualities for success in the role:
- Team player committed to achieving our common goals
- Able to communicate ideas clearly and effectively
- Enjoys challenging work
- Self-motivated and able to work independently
- Trustworthy and full of integrity
- Detail-oriented and quality-driven