Log10United States

AI Researcher / Data Scientist

About Log10 IncLog10 is addressing the challenges around reliability and consistency of LLM-powered applications via a platform that provides AI-powered evaluations, fine-tuning and debugging tools.

AI Researcher / Data Scientist

AI Researcher / Data Scientist

Log10

United States

Full TimeNegotiable
Posted on 23rd Oct 2024

About Log10 Inc

Log10 is addressing the challenges around reliability and consistency of LLM-powered applications via a platform that provides AI-powered evaluations, fine-tuning and debugging tools. We are currently a team of 8 having previously worked in AI and infra roles at companies such as Intel, MosaicML, Adobe, Docker, PostEra, Starburst and Second Measure.

Responsibilities

  • Develop and implement novel AI algorithms to automate improvements of LLM applications
  • Train fine-tuned and reward models based on large datasets to reflect human preferences of domain experts
  • Invent synthetic data generation algorithms to train custom evaluation models and augment human review
  • Collaborate with cross-functional teams to integrate AI solutions into our LLMOps product offerings
  • Stay updated with the latest trends and developments in LLMs, especially evaluations, prompt engineering, fine-tuning and open source models (DBRX, Mistral, Mixtral, Llama-3 etc.)
  • Document and present research findings and methodologies to both internal and external stakeholders

Requirements

  • Master’s or PhD in Computer Science, Machine Learning, Artificial Intelligence, or a related field
  • Proven experience with machine learning algorithms and statistical models. Solid understanding of NLP and experience working with LLMs.
  • Strong programming skills in Python and experience with AI/ML frameworks like TensorFlow, PyTorch, etc.
  • Excellent problem-solving and analytical skills
  • Ability to work independently in an organized manner. Strong communication and collaboration skills
  • Comfortable working with version control (git)
  • Significant post-academic experience

Nice to have

  • Experience in a startup environment
  • Experience with evaluating LLMs, familiarity with research in LLM evaluation, e.g. Prometheus
  • Experience in logging, debugging and fine-tuning large language models
  • Experience developing end-to-end machine learning systems
  • Publications in relevant AI/ML conferences and journals
  • Experience with cloud computing platforms like AWS, GCP, or Azure
  • Knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes)

We provide a competitive salary, equity, and the chance to develop foundational systems that will redefine how companies build AI. This is a high-impact, high-autonomy role for someone eager to take on technical ownership and leadership. If this matches your background and ambitions, we'd love to hear from you!


Instructions

  • Provide Accurate Personal Information
  • If the job requires a CV, ensure that you upload an up to date CV
  • The name on your application should match your legal identification.
  • All Fields marked with * are mandatory
Please ensure you regularly check the email address provided during the application process for any updates from Tuhustle or potential employers. Your application status, interview invitations, or job offers will be sent via email. Respond promptly to any messages to maintain your candidacy.

Job Application Form