Note: The job is a remote job and is open to candidates in USA. CloudApper AI is a leading company in cloud technology, focusing on innovative AI-driven solutions. They are looking for a skilled Data Engineer to develop and optimize data pipelines and implement big data solutions while collaborating with cross-functional teams in a remote work environment.
Responsibilities
- Design, build, and optimize data pipelines, architectures, and data sets
- Work with big data technologies to solve complex data processing challenges
- Implement ETL processes and data warehousing solutions
- Attend meetings, providing pre-sales support and technical insights
- Collaborate with cross-functional teams to integrate data solutions into broader projects
- Engage in cloud-based data solutions using AWS, Azure, or GCP
- Ensure data integrity, efficiency, and scalability in all solutions
Skills
- Strong proficiency in Python
- Experience with SQL and NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
- Expertise in ETL processes and tools
- Proficiency in one or more cloud platforms: AWS, Azure, or GCP, with specific technologies including: AWS: Glue, Redshift, EMR, Lambda, S3, Kinesis, Athena; Azure: Databricks, Data Factory, Azure SQL Database, Blob Storage, Event Hubs; GCP: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage
- Familiarity with big data tools like Hadoop, Spark, or Airflow
- Experience with Snowflake for cloud data warehousing
- Strong problem-solving skills and attention to detail
- Excellent English communication skills for client-facing roles and technical discussions
- Previous consulting or startup environment experience
- Ability to independently handle customer interactions and lead projects
- Proficiency in English is essential for effective communication with clients
- Availability for scheduled client meetings and responsiveness on Slack during EST business hours
- Experience with Looker, PowerBI, Tableau, or Grafana for data visualization
- Experience with machine learning and analytics
- Familiarity with containerization technologies like Docker, Kubernetes, and Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation
- Knowledge of API development and integration
- Experience with streaming technologies such as Kafka or Flink
- Understanding of data privacy and compliance regulations (e.g., GDPR, HIPAA)
Benefits
- Flexible work arrangements to accommodate project needs and personal preferences
- Growth potential in a dynamic environment focusing on AI and cloud technologies
- A culture that values innovation, communication, and proactive problem-solving
- Opportunity to work on innovative projects with significant real-world impact
Company Overview