Note: The job is a remote job and is open to candidates in USA. Data Based Development Systems is seeking a Senior Data Engineer to support complex data solutions and two critical applications serving supply chain and planning operations. The role focuses on maintaining application reliability, supporting Databricks activities, developing data products and ETL processes, managing queue operations, and delivering approved fixes and enhancements.
Responsibilities
- Supporting the continued performance, reliability, and availability of two critical applications, which are essential to our clients supply chain and planning operations
- Help support Databricks activities that minimize disruptions, maintain stable daily operations, and deliver approved fixes or enhancements as required
- Assist with requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products
- Work with the various technology teams and operational stakeholders to support and enhance two applications
- Lead the Queue Management System to ensure timely processing, issue resolution, and continuity of business operations within the applications
- Design and develop database objects, tables, stored procedures, views, etc
- Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
- Understands the concept of Data Marts and Data lakes and experience with migrating legacy systems to data marts/lake
- Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
- Maintain comprehensive project documentation
- Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement
- Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members
- Manage multiple projects, responsibilities and competing priorities
Skills
- Must be a US Citizen
- Experience in projects emphasizing complex data solutions
- Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT
- Database platforms such as: Oracle, SQL Server, MySQL
- Big data concepts and technologies such as Synapse & Databricks
- AWS and Azure cloud computing
Company Overview