Infrastructure Lead/Architect
Required Skills
AWS
Python
ETLs
Databricks
About micro1
micro1 connects domain experts to the development of frontier AI models. Real-world expertise is turned into training data, evaluations, and feedback loops that improve how models perform. AI labs and enterprises use micro1 to train models and build reliable AI agents through advanced evaluations and reinforcement learning environments. Experts contribute directly to how AI systems learn, reason, and perform across domains like finance, healthcare, engineering, and more. Our platform identifies and vets top talent through an AI recruiter, enabling high-quality contributions at scale.
Our goal is to enable 1 billion people to do meaningful work by applying their expertise to AI. We’ve raised $40M+ in funding, and our AI recruiter has powered over 1 million AI-led interviews as our global network of experts grows into the human intelligence layer for AI.
Job Description
Job Title: Infrastructure Lead/Architect
Job Type: Full-Time
Location: On-site Hyderabad, Pune or New Delhi
Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Key Responsibilities
- Architect, design, and implement robust, scalable, and secure AWS cloud infrastructure utilizing services such as EC2, S3, Lambda, RDS, Redshift, and IAM.
- Lead the end-to-end design and deployment of high-performance, cost-efficient Databricks data pipelines, ensuring seamless integration with business objectives.
- Develop and manage data integration workflows using modern ETL tools in combination with Python and Java scripting.
- Collaborate with Data Engineering, DevOps, and Security teams to build resilient, highly available, and compliant systems aligned with operational standards.
- Act as a technical leader and mentor, guiding cross-functional teams through infrastructure design decisions and conducting in-depth code and architecture reviews.
- Oversee project planning, resource allocation, and deliverables, ensuring projects are executed on-time and within budget.
- Proactively identify infrastructure bottlenecks, recommend process improvements, and drive automation initiatives.
- Maintain comprehensive documentation and uphold security and compliance standards across the infrastructure landscape.
Required Skills and Qualifications
- 8+ years of hands-on experience in IT infrastructure, cloud architecture, or related roles.
- Extensive expertise with AWS cloud services; AWS certifications are highly regarded.
- Deep experience with Databricks, including cluster deployment, Delta Lake, and machine learning integrations.
- Strong programming and scripting proficiency in Python and Java.
- Advanced knowledge of ETL/ELT processes and tools such as Apache NiFi, Talend, Airflow, or Informatica.
- Proven track record in project management, leading cross-functional teams; PMP or Agile/Scrum certifications are a plus.
- Familiarity with CI/CD workflows and Infrastructure as Code tools like Terraform and CloudFormation.
- Exceptional problem-solving, stakeholder management, and both written and verbal communication skills.
Preferred Qualifications
- Experience with big data platforms such as Spark or Hadoop.
- Background in regulated environments (e.g., finance, healthcare).
- Knowledge of Kubernetes and AWS container orchestration (EKS).