hero

Jobs at Alumni Ventures Portfolio Companies

447
companies
2,318
Jobs

Retrieval Augmented Generative AI Engineer

Unstructured

Unstructured

Software Engineering · Full-time
San Francisco, CA, USA
Posted on Friday, February 2, 2024

Unstructured.io is a cutting-edge technology company at the forefront of developing innovative solutions for processing and extracting insights from unstructured data. Our mission is to empower businesses with actionable intelligence derived from text, images, and other unstructured sources. As we continue to grow, we are seeking a results-oriented Retrieval Augmented Generative AI (RAG) Engineer to contribute significantly to our RAG pipelines.

We are seeking a highly skilled RAG Engineer to develop state-of-the-art retrieval-augmented generation solutions. The ideal candidate will be at the forefront of experimenting with various chunking and retrieval strategies, fine-tuning large language models (LLMs) for optimal performance, and applying Unstructured partitioning strategies to ensure successful adoption across diverse sectors. This role is crucial in achieving the best RAG results on client data and contributing to the broader AI and machine learning community.

Key Responsibilities:

- **End-to-End RAG Solution Development:** Lead the experimentation of different chunking and retrieval methods to enhance the efficiency and effectiveness of RAG systems. Developing, training, fine-tuning LLMs for RAG. Ability to come up with new ideas and improve them over time is very important to make our technology fit the needs of complicated business projects.
- **Performance Benchmarking:** Conduct thorough evaluations of model and application performance. This entails a deep dive into model accuracy, bias identification, and the formulation of strategies for ongoing enhancement. Analytical skills that drive continuous improvements and set new benchmarks for excellence.
- **Cross-Industry Collaboration:** Engage with customers from various sectors to facilitate the successful adoption of Unstructured APIs. Bridge the gap between cutting-edge AI technology and industry-specific applications, ensuring clients achieve their strategic objectives.

Qualifications:

- Bachelor's or advanced degree in Computer Science, Engineering, or a related field. Advanced degree preferred.
- Proven experience (5+ years) in machine learning engineering, data science, or related roles.
- Strong analytical and problem-solving skills.
- Excellent programming skills and debugging skills. Including experience with Python, Bash, as well as Cloud services, and Linux.
- Ability to multitask effectively in a dynamic environment.
- Clear written and communication skills with the ability to effectively collaborate with executives and engineering teams.

Why Join Unstructured.io:

- Opportunity to lead a dynamic team and work on cutting-edge machine learning projects.
- Collaborative and innovative work environment with a focus on learning and growth.
- Impactful role in shaping the company's technical direction and driving innovation in unstructured data processing.
- Competitive compensation package, including benefits and stock options.
Unstructured is an equal opportunity employer.