Senior Python Engineer
Europe (excluding UK) – Remote
$5,000 to $6,500 per month, based on experience
Typical hours are Monday-Friday working UTC/UTC+1 with potential on-call support required
Our Data Ingest team scrapes the data that powers insights for the world's biggest companies, central banks and organisations, and we’re looking for a Senior Python Engineer to join them. You’ll shape how we capture, process and scale the data pipelines that underpin our insights and fuel our products.
What success looks like in this role:
Build & Improve
Implementing new scrapers and maintaining existing ones
Improving the scraping platform in the areas of data quality, performance and observability
Own & Investigate
Carrying out research and technical investigations
Taking on ownership of architectural or conceptual components of the platform (e.g. owning reliability or QA processes or AI scrapers)
Collaborate & Refine
Gaining sufficient understanding of the codebase to make contributions aimed at reducing overall complexity and removing technical debt
Performing code reviews, participating in intra and cross-team technical initiatives and discussions
About the team:
The team has run for seven years, with over 200 scrapers and one mission: reliably collecting the financial data that powers our products
You will join a technical team of c. 40 technologists with a key purpose of continuously and reliably collecting large amounts of financial data describing cross-border payments, then processing the data, checking the quality and serving it to our users so that they can make the best business decisions
The Data Ingest team is the oldest team at FXC Intelligence, having existed in some form for over seven years now. We provide the platform for collecting unstructured data from open third-party websites and mobile apps, and make sure that the data collected corresponds to the company's data quality standards and SLAs. As the business grows and requirements change, so do we – the platform has survived several iterations and is currently in the process of being migrated to its fourth generation. The team also maintains over 200 scrapers for different providers of data, which power most of the company’s critical datasets
You should apply if you can confidently:
Technical skills
Engineer robust solutions using advanced Python and SQL to solve complex data and backend challenges
Work with data processing and distributed high-load systems
Experience with event-driven architecture and message queues (RabbitMQ/Kafka)
Perform basic exploratory data analysis and make technical decisions on the basis of observed data rather than just assumptions
Ways of working
Take proactive ownership of projects, setting a high bar for technical excellence
Thrive in fast-paced environments, pivoting quickly to meet changing priorities without losing momentum
Articulate complex ideas clearly to both technical and non-technical stakeholders
Deep-dive into the business domain to ensure your technical output aligns with product goals and user needs
Approach every challenge with a positive attitude and a proactive drive to learn new technologies and methodologies
It’s a bonus if you also have:
Domain experience
Prior experience working for a data product company or being involved with Big Data
Experience collaborating with a BI, DA and/or ML team
Technical extras
Build and maintain scalable web scraping architectures and backend systems that power core product features
Experience with documentation of system architecture
Tech Stack:
Python, PostgreSQL, RabbitMQ, Redis, Puppeteer, Playwright, Selenium, Pandas, Numpy and SKlearn
About us:
FXC Intelligence is a leading provider of cross-border payments data and intelligence, providing some of the world's biggest companies, central banks and non-governmental organisations with the strategic insights, expertise and awareness to effectively compete in their chosen markets. By joining us, you will be diving into a world of data-driven exploration and innovation, revolutionising financial insights through cutting-edge technologies, machine learning and predictive analytics.
Your contributions will shape the future of cross-border finance, helping clients to uncover better paths to growth and profitability, as well as being a trusted reference and source for many of the leading international publications.
We are proud to produce industry-changing data and intelligence, aided by our company values of being customer-focused, taking ownership, knowledge, communication and leadership.
We’re an innovative company that strives to look after its team, and we take pride in providing a positive company culture. Feel free to check out our blog, Instagram and Glassdoor pages to learn more about our culture and hear directly from our team about what it's really like to work with us!
Read more about being a Consultant at FXC Intelligence here
At FXC Intelligence, we believe in embracing diversity in all forms and fostering an inclusive environment. All applicants will be considered for employment without attention to ethnicity, religion, sexual orientation, gender identity, family or parental status, national origin, veteran status, neurodiversity status or disability status.
AI Usage Disclaimer:
At FXC Intelligence, we are enthusiastic about the use of AI tools and value candidates with experience or interest in AI technologies. However, we kindly ask that candidates refrain from using AI tools during interviews or for technical tasks unless explicitly instructed by us. This is because we want to understand your thought process and approach to tasks. If AI assistance is used in tasks or interviews where it was not permitted and is detected, the submission may be discounted.
Advanced Python and SQL, distributed high-load systems, event-driven architecture, message queues, exploratory data analysis, and scalable web scraping or backend systems experience.
Key Responsibilities
- building scrapers
- improving platforms
- reviewing code
Skills & Tools
Python, SQL, RabbitMQ, Kafka, PostgreSQL, Redis, Puppeteer, Playwright, Selenium, Pandas, NumPy, Scikit-learn
Job Details
- Category: Software Development
- Seniority: Senior Level
- Commitment: Full Time
- Workplace: Remote — Europe
- Salary: USD 60,000 – 78,000 / year
- Languages: English
About FXC Intelligence
A provider of cross-border payments data and intelligence for companies, financial institutions, and organisations. — Industry: Finance