About the Company
Transflo provides mobile, telematics, and business process automation software for the transportation and logistics industry. Its SaaS and AI solutions help freight carriers, brokers, and shippers streamline operations, reduce costs, and improve efficiency through better communication and collaboration across the supply chain.
About the Role
Transflo is seeking a Senior Data Engineer to architect and own its enterprise data platform, from raw data ingestion to curated, analytics-ready data products. You will play a central role in building the company’s data warehouse, pipeline infrastructure, and bronze-silver-gold medallion architecture.
This role combines hands-on engineering with platform architecture and technical ownership. You will work with data from APIs, relational databases, NoSQL systems, files, and streaming sources, transforming it into reliable, governed datasets for analytics, operational reporting, and Data as a Service (DaaS) capabilities.
The platform must support high-volume, mission-critical workloads and near real-time data delivery across transportation and logistics operations.
Key Responsibilities
•Architect, build, and optimize an enterprise data warehouse using Amazon Redshift, including schema design, data integrity, and query performance.
•Implement bronze, silver, and gold data layers for raw ingestion, data cleansing, standardization, and curated analytics-ready products.
•Develop dimensional data models, fact and dimension tables, slowly changing dimensions (SCDs), and aggregate structures for BI, analytics, and API consumption.
•Build and maintain batch and streaming pipelines that ingest data from REST APIs, flat files, IBM DB2, MySQL, Amazon Aurora, Amazon DynamoDB, and PostgreSQL.
•Implement real-time and near real-time streaming solutions using AWS services such as Kinesis Data Streams, Kinesis Firehose, Amazon MSK, and EventBridge.
•Develop ETL/ELT workflows using AWS Glue, dbt, Apache Airflow, or comparable orchestration tools.
•Build reliable pipelines with fault tolerance, idempotency, automated recovery, alerting, and observability.
•Establish automated data quality processes covering profiling, cleansing, deduplication, standardization, and validation.
•Develop data governance practices for cataloging, lineage, metadata management, classification, and access controls.
•Define data contracts and service-level agreements for data freshness, completeness, and accuracy.
•Work with data scientists, analytics engineers, BI developers, product managers, and API clients to ensure data products meet performance and quality requirements.
•Help build and scale Transflo’s DaaS capabilities through governed APIs and data-sharing mechanisms.
•Use Terraform and infrastructure-as-code practices to maintain reproducible, version-controlled, and auditable data infrastructure.
•Optimize platform performance through partitioning, workload management, concurrency scaling, caching, and query tuning.
•Apply security best practices, including column-level security, row-level access controls, encryption, and audit logging.
•Collaborate with software engineers, mobile platform teams, and DevOps to improve upstream data structures and delivery.
•Use AI-assisted development tools and practices to accelerate pipeline development and improve data quality processes.
Required Qualifications
•5+ years of professional Data Engineering experience building and operating production-grade data warehouses and pipelines.
•Expert-level experience with Amazon Redshift, including cluster sizing, workload management (WLM), distribution and sort keys, vacuuming, and query plan analysis.
•Advanced SQL skills, including complex analytical queries, window functions, common table expressions (CTEs), stored procedures, and performance tuning.
•Hands-on experience ingesting data from REST APIs, IBM DB2, MySQL, Amazon Aurora, Amazon DynamoDB, PostgreSQL, and file formats such as CSV, JSON, Parquet, and Avro.
•Experience designing and implementing enterprise-scale medallion or equivalent layered data architectures.
•Strong understanding of star and snowflake schemas, dimensional modeling, slowly changing dimensions, and fact table granularity.
•Experience building real-time or near real-time pipelines using Amazon Kinesis, Apache Kafka, Amazon MSK, or equivalent technologies.
•Proficiency with ETL/ELT orchestration tools such as AWS Glue, dbt, Apache Airflow, or AWS Step Functions.
•Experience implementing data governance practices, including data catalogs, lineage, metadata tagging, and access controls.
•Hands-on experience with Terraform for provisioning and managing AWS data infrastructure.
•Strong Python skills for data pipeline development, transformation, and automation.
•Deep understanding of data reliability engineering, including idempotency, exactly-once processing, late-arriving data, schema evolution, and SLA-driven pipeline design.
Preferred Qualifications
•Experience in transportation, logistics, trucking, or fleet management, or with high-volume SaaS platforms processing operational telemetry data.
•Experience building Data as a Service offerings, governed external data APIs, Redshift Data Sharing, or AWS Data Exchange integrations.
•Knowledge of columnar storage formats such as Parquet and ORC, along with Amazon S3 data lake architectures using Redshift Spectrum or AWS Glue.
•Familiarity with BI and analytics tools such as Tableau, Power BI, Amazon QuickSight, or Looker.
•Experience with data observability and quality tools such as Monte Carlo, Great Expectations, or dbt tests.
•Experience developing reusable data platform tools, shared dbt packages, or internal data engineering frameworks.
•Experience working with fully remote, distributed engineering teams.
Employment Details
•Job Title: Senior Data Engineer
•Company: Transflo
•Industry: Transportation and Logistics Technology
•Work Arrangement: Not specified in the source
•Employment Type: Not specified in the source
•Salary and Benefits: Not specified in the source