
Technical Delivery Lead (Java / Big Data and AI)
Role Summary
We are seeking an accomplished, visionary Technical Delivery Lead (Java, Big Data & AI) to spearhead the end-to-end delivery of enterprise-grade Regulatory Reporting solutions on our strategic RegHub platform.
This high-impact leadership role sits at the intersection of high-throughput distributed computing, real-time event streaming, modern microservices, and cutting-edge Generative / Agentic AI technologies. The ideal candidate will combine deep hands-on technical authority in Java and Big Data ecosystems with strong delivery governance, cross-functional stakeholder leadership, and practical expertise in deploying AI-driven solutions to automate, optimize, and future-proof critical regulatory operations.
Key Responsibilities
Delivery Governance & End-to-End Execution
- Ownership of Technical Delivery: Assume full accountability for the technical delivery lifecycle of complex, high-visibility regulatory reporting initiatives under stringent regulatory deadlines.
- Delivery Governance & Quality: Establish and enforce architecture review boards, code quality metrics, non-functional requirement (NFR) verifications, robust test coverage, and production readiness frameworks.
- Performance & Scalability Optimization: Drive performance benchmarking, tuning, and reliability engineering across high-volume, low-latency, mission-critical distributed platforms.
- Architecture, Distributed Systems & Real-Time Data Streaming
- Event-Driven Architectures: Architect and deliver resilient, horizontally scalable microservices and event-driven data streaming pipelines leveraging Kafka, Apache Spark, Apache Flink , and the broader Big Data ecosystem.
- Data Persistence & Retrieval: Design robust data layer strategies across relational, NoSQL, and search engines ( Oracle, MongoDB, Hive/Impala, Elasticsearch ).
- Hybrid & Cloud-Native Engineering: Lead containerization and cloud modernization initiatives across AWS, OpenShift, Kubernetes, and Docker .
AI & Intelligent Automation Innovation
- Agentic AI & GenAI Implementation: Champion and operationalize AI/ML, Generative AI, and Agentic AI workflows to transform regulatory rule parsing, data reconciliation, anomaly detection, automated test generation, and platform operations.
- RAG & Vector Search Systems: Lead the design and delivery of Retrieval-Augmented Generation (RAG) architectures, multi-agent frameworks ( LangGraph, CrewAI, AutoGen ), vector databases, tool-calling pipelines, and Model Context Protocol (MCP) integrations.
- AI Safety & Enterprise Guardrails: Ensure all AI capabilities conform to enterprise risk, model validation, data privacy, and regulatory governance standards.
Regulatory Controls, Data Lineage & Governance
- Data Integrity & Traceability: Embed end-to-end data lineage, audit logging, data quality rules, and regulatory control points across the entire ingestion-to-submission pipeline.
- Stakeholder Collaboration: Partner closely with Business, Compliance, Internal Audit, Risk, and Operations partners to translate intricate global regulatory mandates into robust, scalable engineering solutions.
People Leadership & Engineering Culture
- Mentorship & Team Enablement: Lead, coach, and elevate high-performing engineering pods; foster continuous learning and an engineering excellence culture.
- DevOps & Release Modernization: Promote CI/CD best practices, automated deployment pipelines, infrastructure-as-code, and disciplined release management.
Qualifications & Skills
Core Architecture & Engineering
- Experience: 10+ years of progressive, hands-on software engineering and technical architecture experience in enterprise distributed systems.
- Java Ecosystem: Mastery of Core Java (Java 17+), Spring Framework (Spring Boot, Spring Cloud, Spring Data), Microservices architecture, and secure RESTful API design.
- Real-Time & Big Data Processing: Deep expertise in building low-latency, high-throughput streaming systems using Apache Kafka, Apache Spark / Spark Streaming, Apache Flink , and Hadoop/distributed computing principles.
- Database & Storage Technologies: Comprehensive experience with MongoDB, Elasticsearch, Oracle, Hive, Impala , and distributed storage patterns.
- Messaging & Middleware: Hands-on experience with enterprise messaging systems ( Kafka, JMS, TIBCO EMS ).
AI, Machine Learning & Generative AI
- Programming & Tooling: Strong proficiency in Python and standard data science/AI toolkits.
- LLMs & GenAI Frameworks: Hands-on experience integrating and fine-tuning frontier Foundation Models (OpenAI GPT, Anthropic Claude, Google Gemini, open-source models).
- Agentic Systems & Frameworks: Practical experience implementing multi-agent workflows using LangChain, LangGraph, CrewAI, AutoGen , or custom orchestration engines.
Cloud, DevOps & Platform Operations
- Containerization & Orchestration: Proven experience with Docker, Kubernetes , and enterprise platforms like Red Hat OpenShift .
- Cloud Infrastructure (AWS): Strong working knowledge of core cloud services ( ECS/EKS, S3, IAM, CloudWatch, CodePipeline/CodeBuild ).
- DevOps & Tooling: Expertise in modern CI/CD tooling, Git/Bitbucket workflows, Jira/Confluence delivery tracking, SonarQube, and automated testing frameworks.
Preferred / Differentiating Qualifications
- Prior experience in Financial Services, Investment Banking, Capital Markets , or Regulatory Reporting
- Experience leading large-scale legacy platform modernization to event-driven, cloud-native architectures.
- Relevant professional certifications in Cloud (AWS Certified Solutions Architect), Kubernetes (CKA), or AI/ML.
Competencies & Soft Skills
- Strategic Delivery Leadership: Ability to navigate complex delivery dependencies, manage delivery risk, and execute against critical milestones.
- Executive Communication: Exceptional verbal and written communication skills to bridge deep technical mechanics with business outcomes.
- Pr
Never pay to get work. If a listing asks for a fee, it is a scam. The ten signs →