Note: The job is a remote job and is open to candidates in USA. Digital Envoy is a leader in IP geolocation and VPN intelligence serving customers across streaming media, AdTech, cybersecurity, e-commerce, and data analytics. The Senior Data Engineer will develop and maintain sustainable data integration pipelines, build scalable data tools and warehousing systems, and support customer-facing data products and timely analyses.
Responsibilities
- Use Spark, Python, and SQL to perform ETL on billions of location records per day
- Implement pipelines in AWS EMR + Airflow to generate customer facing data products
- Write complex SQL, including geospatial, to perform data analysis
- Build dashboards in Tableau to surface data-driven insights
- Develop scripts in Python, Spark and Postgis to acquire and curate spatial data
Skills
- • 7+ years of data engineering or relevant industry experience
- • 4+ years experience and working proficiency with Spark
- • Strong Python Skills
- • Advanced proficiency with SQL, comfortable with complex joins and window functions
- • Familiarity with orchestration systems, preferably Airflow
- • Experience with AWS data engineering products (S3, EMR, Athena...) or similar tools from other cloud providers
- • Self-initiative and an entrepreneurial mindset
- • Strong communication skills
- • Passion for data
- • Bachelor's Degree in Computer Science or related technical areas like Math, Statistics, and/or other Engineering degrees
- All employees must be authorized to work in the United States
- • Working knowledge of Scala
- • Proficiency with building Tableau dashboards
- • Experience with spatial data, joins and operations
- • Familiarity with Snowflake
- • Experience with Machine Learning
- • Background in AdTech or Cybersecurity fields
Benefits
- Competitive Salary & Bonus program
- Medical, Dental and Vision
- Paid Holidays & Unlimited PTO policy
- 401(k) with employer contribution match
- Remote work from any of the listed states: California, Colorado, Connecticut, Florida, Georgia, Kentucky, Massachusetts, Michigan, New York, New Jersey, North Carolina, Pennsylvania, South Carolina, Tennessee, Texas, Virginia, or Washington
- Georgia residents are encouraged and welcomed to join us a couple days/week in our Peachtree Corners, Georgia office
Company Overview