Note: The job is a remote job and is open to candidates in USA. Tekmetric is a cloud-based platform designed to enhance the operations of auto repair shops. They are seeking a Senior Software Engineer with expertise in web scraping, data processing, and search technologies to build a large-scale data ingestion and classification system, utilizing tools like Python, ElasticSearch, and AWS.
Responsibilities
- Build and design large scale, distributed crawling bots (perhaps AI agents) and infrastructure that operate in an adversarial environment aiming at low operational overhead
- Develop and maintain data pipelines to extract data from large volumes of web pages, documents, PDFs (OCR), and APIs
- Help unify heterogeneous documents into a coherent data schema across varied source formats
- Preprocess and normalize raw data for downstream classification, ML/NLP, and search indexing
- Build APIs to expose structured, classified data via ElasticSearch/OpenSearch
- Collaborate with ML/NLP teams to integrate classification models into the pipeline
- Automate workflows using Apache Airflow and deploy solutions in Kubernetes on AWS
- Optimize and scale data pipelines using Spark (EMR) for processing large datasets
Skills
- 5+ years of experience in Python with building crawling/scraping solutions at scale
- Experience working with APIs (REST), PDF processing (OCR, Tesseract, PyMuPDF etc.)
- Proficiency in data processing & search technologies (ElasticSearch/OpenSearch, NoSQL/SQL databases)
- Hands-on experience with Airflow and Spark (EMR) or similar distributed systems
- Strong problem-solving skills in handling anti-scraping mechanisms and data scaling challenges
- Hands-on experience with AWS or GCP
- Familiarity with NLP and Machine Learning (a plus but not required)
- Experience with LLMs, NLP models, or ML frameworks (e.g., Hugging Face, spaCy, TensorFlow, PyTorch)
- Prior experience in automated document classification
- Experience working in high-scale, production environments with petabytes of data
- Hands-on experience with Kubernetes
Benefits
- Enjoy the flexibility of remote work
- Competitive base salaries that reflect your value.
- Generous Paid Time Off, because we know you do your best work when you're well-rested.
- Support for every stage of life—with paid maternity, parental bonding, and medical leave for you or your loved ones.
- Comprehensive health benefits, including Medical, Dental, Vision, and Prescription coverage. For employee only, we offer plans that cover 100% of premiums and we cover 50% of costs for families.
- Prioritizing your mental health: get free, confidential counseling through our partnership with BetterHelp.
- 401(k) Retirement Savings Plan with 100% employer match on contributions up to 6% - so your future self will thank you.
- Flexible Spending Accounts (FSA) and Health Savings Accounts (HSA) to make your money go further.
- Life and Accidental Death & Dismemberment (AD&D) Insurance for added peace of mind.
- Wellness on your terms: get up to $60/month toward fitness, mental health, or almost anything that helps you feel your best.
- After one year of employment, enjoy a $300 home office setup bonus to help make your space work for you.
- Keep growing with support for continuing education - we’re invested in your development.
Company Overview
Company H1B Sponsorship