FuriosaAI

Dudaji Uses FuriosaAI's WARBOY to monitor workplace safety

News

Forestfire

Summary

  • Dudaji, a Korean AI services provider, used FuriosaAI’s WARBOY card to build CV systems to monitor workplace safety in real time using the YOLO family of object detection algorithms.

  • Dudaji was able to easily export their custom models for fire detection and other tasks to WARBOY using ONNX, achieving 40FPS using YOLOv5s running eight concurrent streams.

  • Dudaji found the quality of Furiosa’s SDK and model zoo made WARBOY an ideal solution for CV workplace safety applications.

Share this article

Dudaji, a Korean company that builds custom computer vision and natural language processing solutions for businesses, is building new services that use Furiosa's WARBOY accelerator for highly efficient inference at scale. As part of that work, they evaluated how well WARBOY will work for demanding applications such as monitoring workplace safety, where the AI system must quickly detect complex issues such as an employee not using protective equipment or driving dangerously on a worksite.

Dudaji successfully ported a range of custom YOLO object detection models to WARBOY and then optimized them through calibration and quantization. The end result achieved 40 FPS on eight concurrent streams using a YOLOv5s model for tasks including fire detection, worker detection, safety gear detection and construction site monitoring. 

The models were tested for performance and also for efficiency, which is critical in real-time monitoring situations where rapid and reliable inference is necessary. Peak performance was 330FPS in total on a single WARBOY card.

“The model performs excellently in actual environments, detecting fires accurately and contributing to the prevention of fire damage,” said Dudaji’s Joonwon Lee. z

Report

End to end deployment

Dudaji began by assessing WARBOY’s model zoo. In evaluating a potential AI hardware solution, it’s crucial that the device supports the algorithms that will work best for a variety of applications. The YOLO family of models has become an industry standard because of its ability to perform real-time object detection in a single pass, making it much faster than traditional CNNs. WARBOY supports YOLOv5m, YOLOv5L, and YOLOv7w6Pose (for pose estimation).

WARBOY is available on Kakao Cloud, so Dudaji was able to easily access the WARBOY instance remotely and test the Furiosa SDK's compatibility with public models and custom algorithms. They confirmed WARBOY’s SDK was compatible with major AI frameworks like PyTorch and TensorFlow Lite.

The WARBOY SDK allows engineers to easily convert Torch models to the ONNX format, so they can then calibrate and quantize using ImageNet samples.

Use cases

The models specializing in a variety of workplace safety tasks.

Optimization

Dudaji performed distributed parallel execution of experiments to select models based on quantitative metrics (time accuracy) and various quantization algorithms (e.g., MIN_MAX_ASYM, ENTROPY_ASYM) suitable for different data sets. They found MinMax calibration was most effective.


        {
  "model_name": "resnet50_01",
  "inference_engine": "onnxruntime",
  "image": "dudaji/quant-simul-cl-onnxruntime",
  "module_root_path": "module/resnet50",
  "input_model_path": "module/resnet50/input_model.onnx",
  "data_location_type": "file",
  "val_dataset": "dataset/imagenet",
  "calib_dataset": "dataset/imagenet/data",
  "algorithm": [
    "ORG",
    "KL",
    "PC3",
    "PC4",
    "PC5",
    "MinMax"
  ],
  "targets": [
    {
      "data_names": [
        "time",
        "accuracy"
      ],
      "regex": "Last Time: (\\d+\\.\\d+) ms Accuracy: (\\d+\\.\\d+)%"
    }
  ],
  "target_end": "benchmark ended",
  "sample_size": 500,
  "test_size": 500
}

{
  "id": "645214edbe2f90a7f700e3c2",
  "algorithm": [
    "ORG",
    "KL",
    "PC3",
    "PC4",
    "PC5",
    "MinMax"
  ],
  "val_dataset": "dataset/imagenet",
  "calib_dataset": "dataset/imagenet/data",
  "ORG": {
    "time": "166.75",
    "accuracy": "73.65269"
  },
  "KL": {
    "time": "112.87",
    "accuracy": "73.05389"
  },
  "PC3": {
    "time": "96.19",
    "accuracy": "39.72056"
  },
  "PC4": {
    "time": "107.39",
    "accuracy": "71.45709"
  },
  "PC5": {
    "time": "104.19",
    "accuracy": "72.65469"
  },
  "MinMax": {
    "time": "112.56",
    "accuracy": "73.05389"
  }
}
      

A JSON-formatted configuration request.

        id                     645214edbe2f90a7f700e3c2
algorithm              ['ORG', 'KL', 'PC3', 'PC4', 'PC5', 'MinMax']
val_dataset            dataset/imagenet
calib_dataset          dataset/imagenet/data
ORG                    {'time': '166.75', 'accuracy': '73.65269'}
KL                     {'time': '112.87', 'accuracy': '73.05389'}
PC3                    {'time': '96.19', 'accuracy': '39.72056'}
PC4                    {'time': '107.39', 'accuracy': '71.45709'}
PC5                    {'time': '104.19', 'accuracy': '72.65469'}
MinMax                 {'time': '112.56', 'accuracy': '73.05389'}

      

The "MinMax" algorithm provided the best combination of speed and accuracy.

In testing the YOLOv5s model, Dudaji found preprocessing took between 4 and 10 minutes (including model optimization, calibration, quantization), and inference operated at approximately 40 frames per second (FPS).

Diagram

Dudaji reported high levels of operational stability with WARBOY, even under continuous operation and in scenarios simulating overload conditions. The company’s engineers assessed WARBOY’s stability during prolonged continuous operation and in overload situations and found there were no hardware faults or other errors over the project’s six-month test period. This reliability is crucial for ensuring uninterrupted safety monitoring in critical work environments.

Dudaji is now preparing to work with FuriosaAI to port additional applications (e.g., detecting copyright infringement and language translation) to Furiosa’s second-gen chip, RNGD, which will launch later in 2024.

Share this article

Get the latest news

Sign up to stay informed on news and updates on Furiosa AI.