About the Job

• FuriosaAI is looking for passionate AI Software Engineers to join our Platform Team. You will participate in the research and development of models optimized for our NPU accelerator.

• Our team builds the production-grade, streamlined AI software that makes up our SDK. This includes the runtime, LLM serving framework, and PyTorch models/extensions.

• Your work on these critical parts of the SDK will directly enable AI developers to efficiently deploy optimized AI models on FuriosaAI NPUs.

Responsibilities

• Develop and optimize DNN model implementations in PyTorch for FuriosaAI's Tensor Contraction Processor (TCP) architecture

• Analyze the features, implementations, CUDA and Triton kernels of existing AI model inference frameworks such as vLLM, TensorRT-LLM, and DeepSpeed-MII

• Research and implement generative AI models, parallelism strategies, and inference techniques to improve performance and efficiency

• Collaborate closely with the compiler team to optimize and enable models.

Minimum Qualifications

• BS degree in Computer Science, Engineering, or a related field, or equivalent industry experience

• Proficiency in Python programming skill

• Experience in developing AI models in DNN frameworks (e.g., PyTorch)

• Solid understanding of machine learning, deep learning, natural language processing (NLP), and/or generative AI models

• Strong communication skills with the ability to collaborate effectively across cross-functional teams

Preferred Qualifications

• Hands-on experience with PyTorch 2.0 technologies (e.g., TorchDynamo) or DNN compiler technologies, such as Triton and MLIR

• Proficiency in C++/CUDA or Rust programming skills

• Hands-on experience deploying and optimizing large-scale ML models in production

• Hands-on experience in model training and fine-turning of pre-trained models

• Experience in LLM inference frameworks: vLLM, TensorRT-LLM, and DeepSpeed-MII

• Strong background in model quantizations and model evaluations

• Strong background in machine learning, generative AI, and model evaluation techniques

• Proven track record of contributing to open-source projects

Contact

• ywkim@furiosa.ai