Note: The job is a remote job and is open to candidates in USA. Anivas Technology is seeking an Apache NiFi Engineer / Data Integration Engineer to support enterprise data onboarding, integration, and transformation in a Zero Trust environment. The role designs and maintains secure, scalable NiFi data flows, develops custom processors, integrates enterprise systems, and supports metadata governance and security compliance.
Responsibilities
- Design, develop, test, deploy, and maintain complex Apache NiFi data flows supporting enterprise data onboarding and integration requirements
- Engineer scalable and fault-tolerant ingestion pipelines capable of processing structured, semi-structured, and unstructured data
- Develop reusable flow frameworks and integration patterns to accelerate onboarding activities
- Optimize flow performance, throughput, latency, and resource utilization across clustered environments
- Troubleshoot and resolve complex data movement, transformation, and processing issues
- Develop custom Apache NiFi processors, controller services, reporting tasks, and extensions using Java
- Create specialized processors supporting:
- Metadata extraction
- Schema validation
- Data tagging
- Attribute enrichment
- Security classification enforcement
- Data quality validation
- API integrations
- Workflow automation
- Extend NiFi capabilities to support mission-specific onboarding requirements
- Develop shared processor libraries and reusable components
- Integrate enterprise systems using:
- REST APIs
- SOAP Services
- JDBC/ODBC Connections
- Message Queues
- Kafka
- File-Based Transfers
- Cloud Storage Services
- Design data ingestion and routing strategies across multiple environments
- Support onboarding of mission and enterprise data assets into approved repositories and data services
- Implement metadata collection, tagging, and enrichment capabilities within data onboarding workflows
- Support enterprise data catalog and governance initiatives
- Ensure onboarding workflows comply with metadata standards, taxonomy requirements, and stewardship processes
- Collaborate with Data Stewards and Data Owners to improve data quality and discoverability
- Implement secure data movement patterns aligned with Zero Trust principles
- Integrate authentication, authorization, encryption, and auditing capabilities into data pipelines
- Coordinate with cybersecurity and Zero Trust teams to ensure compliance with enterprise security requirements
- Support Attribute-Based Access Control (ABAC) and policy-driven data access models
Skills
- 12+ years experience
- Experience working with users to help define their database use, data analytics, and the data user experience
- 12+ years of data integration, ETL, or enterprise middleware experience
- 8+ years of hands-on Apache NiFi development experience
- Experience designing and supporting large-scale enterprise data ingestion architectures
- Experience onboarding new data sources and integrating complex systems
- NiFi Flow Design
- Process Groups
- Remote Process Groups
- Site-to-Site Communications
- Controller Services
- Parameter Contexts
- Flow Versioning
- NiFi Registry
- Clustered Deployments
- Provenance Tracking
- Back-Pressure Management
- Flow Performance Tuning
- Secure Flow Design
- Java-based NiFi Processors
- Controller Services
- Reporting Tasks
- Custom APIs
- Schema Validation Components
- Metadata Extraction Processors
- Content Parsing Processors
- Security Enforcement Processors
- Data Quality Validation Processors
- Java
- Spring Framework
- JSON
- XML
- Avro
- Parquet
- REST APIs
- SQL
- PostgreSQL
- Elasticsearch
- Kafka
- Git
- Docker
- Kubernetes
- Linux
- Zero Trust Architecture
- Data-Centric Security
- PKI
- TLS
- Identity and Access Management
- Data Governance
- Metadata Management
- Enterprise Architecture Principles
- Active TS/SCI clearance required
- Experience supporting DIA, NSA, NGA, or other Intelligence Community customers
- Experience integrating with Data Catalog platforms and metadata repositories
- Experience with ontology, taxonomy, and semantic tagging implementations
- Familiarity with Cloudera DataFlow, Hortonworks DataFlow, or large-scale NiFi deployments
- Experience developing automated onboarding workflows
- Knowledge of enterprise data governance and stewardship processes
- Experience operating in highly regulated or classified environments
- Bachelor's degree in Computer Science, Engineering, Information Systems, or related technical discipline
Company Overview