Appendix

Inference Time Table for Models of Different Sizes

Instance Segmentation Model

Model Type

Mode Type

Hardware

Image Resolution

Inference Time

Memory Usage(Total12288)

Instance Segmentation - Ultra Fast

DaoAI World Server

RTX 4080

1024

23ms

Instance Segmentation - Ultra Fast

DaoAI World Server

RTX 4080

512

33ms

Instance Segmentation - Ultra Fast

DaoAI World Server

RTX 4080

256

21ms

Instance Segmentation - Ultra Fast

SDK - GPU Mode

RTX 3060

1024

54.4545 ms

2826.24

Instance Segmentation - Ultra Fast

SDK - GPU Mode

RTX 3060

512

31.449 ms

1474.56

Instance Segmentation - Ultra Fast

SDK - GPU Mode

RTX 3060

256

25.3044 ms

1228.8

Instance Segmentation - Ultra Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

367.388 ms

Instance Segmentation - Ultra Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

116.298 ms

Instance Segmentation - Ultra Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

51.9871 ms

Instance Segmentation - Fast

DaoAI World Server

RTX 4080

1024

46ms

Instance Segmentation - Fast

DaoAI World Server

RTX 4080

512

34ms

Instance Segmentation - Fast

DaoAI World Server

RTX 4080

256

30ms

Instance Segmentation - Fast

SDK - GPU Mode

RTX 3060

1024

81.1401 ms

4177.92

Instance Segmentation - Fast

SDK - GPU Mode

RTX 3060

512

34.8945 ms

3194.88

Instance Segmentation - Fast

SDK - GPU Mode

RTX 3060

256

26.0753 ms

2826.24

Instance Segmentation - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

700.394 ms

Instance Segmentation - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

235.015 ms

Instance Segmentation - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

84.5746 ms

Instance Segmentation - Accurate

DaoAI World Server

RTX 4080

1024

46ms

Instance Segmentation - Accurate

DaoAI World Server

RTX 4080

512

35ms

Instance Segmentation - Accurate

DaoAI World Server

RTX 4080

256

33ms

Instance Segmentation - Accurate

SDK - GPU Mode

RTX 3060

1024

219.317 ms

1597

Instance Segmentation - Accurate

SDK - GPU Mode

RTX 3060

512

178.71 ms

614

Instance Segmentation - Accurate

SDK - GPU Mode

RTX 3060

256

180.052 ms

491

Instance Segmentation - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

599.197 ms

Instance Segmentation - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

249.069 ms

Instance Segmentation - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

182.579 ms

Instance Segmentation - Rotated Accuracy

DaoAI World Server

RTX 4080

1024

95ms

Instance Segmentation - Rotated Accuracy

DaoAI World Server

RTX 4080

512

88ms

Instance Segmentation - Rotated Accuracy

DaoAI World Server

RTX 4080

256

82ms

Instance Segmentation - Rotated Accuracy

SDK - GPU Mode

RTX 3060

1024

428.867 ms

5529.6

Instance Segmentation - Rotated Accuracy

SDK - GPU Mode

RTX 3060

512

379.047 ms

3440.64

Instance Segmentation - Rotated Accuracy

SDK - GPU Mode

RTX 3060

256

377.128 ms

3317.76

Instance Segmentation - Rotated Accuracy

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

618.77 ms

Instance Segmentation - Rotated Accuracy

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

620.542 ms

Instance Segmentation - Rotated Accuracy

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

614.017 ms

Keypoint Detection Model

Model Type

Mode Type

Hardware

Image Resolution

Inference Time

Memory Usage(Total12288)

Keypoint Detection - Ultra Fast

DaoAI World Server

RTX 4080

1024

32ms

Keypoint Detection - Ultra Fast

DaoAI World Server

RTX 4080

512

20ms

Keypoint Detection - Ultra Fast

DaoAI World Server

RTX 4080

256

17ms

Keypoint Detection - Ultra Fast

SDK - GPU Mode

RTX 3060

1024

47.5819 ms

4300.8

Keypoint Detection - Ultra Fast

SDK - GPU Mode

RTX 3060

512

19.668 ms

1720.32

Keypoint Detection - Ultra Fast

SDK - GPU Mode

RTX 3060

256

14.3904 ms

1228.8

Keypoint Detection - Ultra Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

379.542 ms

Keypoint Detection - Ultra Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

142.759 ms

Keypoint Detection - Ultra Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

39.8093 ms

Keypoint Detection - Fast

DaoAI World Server

RTX 4080

1024

32ms

Keypoint Detection - Fast

DaoAI World Server

RTX 4080

512

21.35ms

Keypoint Detection - Fast

DaoAI World Server

RTX 4080

256

18.12ms

Keypoint Detection - Fast

SDK - GPU Mode

RTX 3060

1024

77.4276 ms

4670

Keypoint Detection - Fast

SDK - GPU Mode

RTX 3060

512

28.7131 ms

1843.2

Keypoint Detection - Fast

SDK - GPU Mode

RTX 3060

256

18.2597 ms

1597.44

Keypoint Detection - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

673.396 ms

Keypoint Detection - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

232.619 ms

Keypoint Detection - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

83.9978 ms

Keypoint Detection - Accurate

DaoAI World Server

RTX 4080

1024

45ms

Keypoint Detection - Accurate

DaoAI World Server

RTX 4080

512

33ms

Keypoint Detection - Accurate

DaoAI World Server

RTX 4080

256

31.91ms

Keypoint Detection - Accurate

SDK - GPU Mode

RTX 3060

1024

77.2057 ms

4055

Keypoint Detection - Accurate

SDK - GPU Mode

RTX 3060

512

40.1725 ms

1966.08

Keypoint Detection - Accurate

SDK - GPU Mode

RTX 3060

256

27.7136 ms

1474.56

Keypoint Detection - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

592.23 ms

Keypoint Detection - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

281.312 ms

Keypoint Detection - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

216.104 ms

Keypoint Detection - Rotated Accuracy

DaoAI World Server

RTX 4080

1024

108ms

Keypoint Detection - Rotated Accuracy

DaoAI World Server

RTX 4080

512

84ms

Keypoint Detection - Rotated Accuracy

DaoAI World Server

RTX 4080

256

78ms

Keypoint Detection - Rotated Accuracy

SDK - GPU Mode

RTX 3060

1024

251.027 ms

4915

Keypoint Detection - Rotated Accuracy

SDK - GPU Mode

RTX 3060

512

198.44ms

4300.8

Keypoint Detection - Rotated Accuracy

SDK - GPU Mode

RTX 3060

256

202.763 ms

4300.08

Keypoint Detection - Rotated Accuracy

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

617.269 ms

Keypoint Detection - Rotated Accuracy

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

603.318 ms

Keypoint Detection - Rotated Accuracy

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

588.54 ms

Object Detection Model

Model Type

Mode Type

Hardware

Image Resolution

Inference Time

Memory Usage(Total12288)

Object Detection - Ultra Fast

DaoAI World Server

RTX 4080

1024

28ms

Object Detection - Ultra Fast

DaoAI World Server

RTX 4080

512

16ms

Object Detection - Ultra Fast

DaoAI World Server

RTX 4080

256

9ms

Object Detection - Ultra Fast

SDK - GPU Mode

RTX 3060

1024

38.86ms

3440.6

Object Detection - Ultra Fast

SDK - GPU Mode

RTX 3060

512

17.42ms

1351.68

Object Detection - Ultra Fast

SDK - GPU Mode

RTX 3060

256

13.88ms

860.16

Object Detection - Ultra Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

623.744 ms

Object Detection - Ultra Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

588.992 ms

Object Detection - Ultra Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

635.231 ms

Object Detection - Fast

DaoAI World Server

RTX 4080

1024

39ms

Object Detection - Fast

DaoAI World Server

RTX 4080

512

227ms

Object Detection - Fast

DaoAI World Server

RTX 4080

256

24ms

Object Detection - Fast

SDK - GPU Mode

RTX 3060

1024

62.0628 ms

4546.56

Object Detection - Fast

SDK - GPU Mode

RTX 3060

512

29.1506 ms

1843.2

Object Detection - Fast

SDK - GPU Mode

RTX 3060

256

24.1712 ms

1720

Object Detection - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

591.486 ms

Object Detection - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

609.078 ms

Object Detection - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

582.923 ms

Object Detection - Accurate

DaoAI World Server

RTX 4080

1024

39ms

Object Detection - Accurate

DaoAI World Server

RTX 4080

512

30ms

Object Detection - Accurate

DaoAI World Server

RTX 4080

256

28ms

Object Detection - Accurate

SDK - GPU Mode

RTX 3060

1024

71.9821 ms

1169

Object Detection - Accurate

SDK - GPU Mode

RTX 3060

512

67.6864 ms

737.3

Object Detection - Accurate

SDK - GPU Mode

RTX 3060

256

31.4061 ms

737.3

Object Detection - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

603.479 ms

Object Detection - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

614.083 ms

Object Detection - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

611.64 ms

Classification Model

Model Type

Mode Type

Hardware

Image Resolution

Inference Time

Memory Usage(Total12288)

Classification Model - Fast

DaoAI World Server

RTX 4080

512

31ms

Classification Model - Fast

DaoAI World Server

RTX 4080

256

28ms

Classification Model - Fast

SDK - GPU Mode

RTX 3060

512

28.3116 ms

1050

Classification Model - Fast

SDK - GPU Mode

RTX 3060

256

25.7988 ms

860

Classification Model - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

593.157 ms

Classification Model - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

623.913 ms

Classification Model - Accurate

DaoAI World Server

RTX 4080

512

28ms

Classification Model - Accurate

DaoAI World Server

RTX 4080

256

28ms

Classification Model - Accurate

SDK - GPU Mode

RTX 3060

512

41.8673 ms

1050

Classification Model - Accurate

SDK - GPU Mode

RTX 3060

256

29.1118 ms

966

Classification Model - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

623.476 ms

Classification Model - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

607.357 ms

Unsupervised Defect Segmentation Model

Model Type

Mode Type

Hardware

Image Resolution

Inference Time

Memory Usage(Total12288)

Unsupervised Defect Segmentation - Accurate

DaoAI World Server

RTX 4080

1024

30ms

Unsupervised Defect Segmentation - Accurate

DaoAI World Server

RTX 4080

512

21ms

Unsupervised Defect Segmentation - Accurate

DaoAI World Server

RTX 4080

256

16ms

Unsupervised Defect Segmentation - Accurate

SDK - GPU Mode

RTX 3060

1024

64.5152 ms

1228.8

Unsupervised Defect Segmentation - Accurate

SDK - GPU Mode

RTX 3060

512

59.1265 ms

1105.92

Unsupervised Defect Segmentation - Accurate

SDK - GPU Mode

RTX 3060

256

31.1374 ms

987

Unsupervised Defect Segmentation - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

69.0775 ms

Unsupervised Defect Segmentation - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

67.405 ms

Unsupervised Defect Segmentation - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

53.719 ms

Supervised Defect Segmentation Model

Model Type

Mode Type

Hardware

Image Resolution

Inference Time

Memory Usage(Total12288)

Supervised Defect Segmentation - Fast

DaoAI World Server

RTX 4080

1024

91ms

Supervised Defect Segmentation - Fast

DaoAI World Server

RTX 4080

512

76ms

Supervised Defect Segmentation - Fast

DaoAI World Server

RTX 4080

256

33ms

Supervised Defect Segmentation - Fast

SDK - GPU Mode

RTX 3060

1024

96.6828 ms

2211.84

Supervised Defect Segmentation - Fast

SDK - GPU Mode

RTX 3060

512

59.9453 ms

491.5

Supervised Defect Segmentation - Fast

SDK - GPU Mode

RTX 3060

256

55.2014 ms

491.52

Supervised Defect Segmentation - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

583.609 ms

Supervised Defect Segmentation - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

597.976 ms

Supervised Defect Segmentation - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

613.505 ms

Supervised Defect Segmentation - Accurate

DaoAI World Server

RTX 4080

1024

228ms

Supervised Defect Segmentation - Accurate

DaoAI World Server

RTX 4080

512

104ms

Supervised Defect Segmentation - Accurate

DaoAI World Server

RTX 4080

256

73ms

Supervised Defect Segmentation - Accurate

SDK - GPU Mode

RTX 3060

1024

224.211 ms

4096

Supervised Defect Segmentation - Accurate

SDK - GPU Mode

RTX 3060

512

112.129 ms

1105.92

Supervised Defect Segmentation - Accurate

SDK - GPU Mode

RTX 3060

256

75.8281 ms

614.4

Supervised Defect Segmentation - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

560.536 ms

Supervised Defect Segmentation - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

602.581 ms

Supervised Defect Segmentation - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

601.867 ms

OCRModel

Model Type

Mode Type

Hardware

Image Resolution

Inference Time

Memory Usage(Total12288)

OCR - Accurate

DaoAI World Server

RTX 4080

1024

55ms

OCR - Accurate

DaoAI World Server

RTX 4080

512

40ms

OCR - Accurate

DaoAI World Server

RTX 4080

256

29ms

OCR - Accurate

SDK - GPU Mode

RTX 3060

1024

60.8318 ms

1197

OCR - Accurate

SDK - GPU Mode

RTX 3060

512

38.3106 ms

1027

OCR - Accurate

SDK - GPU Mode

RTX 3060

256

27.7074 ms

972

OCR - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

616.513 ms

OCR - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

619.354 ms

OCR - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

603.944 ms

Localization Model

Model Type

Mode Type

Hardware

Image Resolution

Inference Time

Memory Usage(Total12288)

Localization - Fast

DaoAI World Server

RTX 4080

1024

48ms

Localization - Fast

DaoAI World Server

RTX 4080

512

34ms

Localization - Fast

DaoAI World Server

RTX 4080

256

21ms

Localization - Fast

SDK - GPU Mode

RTX 3060

1024

90.5635 ms

4546.56

Localization - Fast

SDK - GPU Mode

RTX 3060

512

34.7482 ms

3686.4

Localization - Fast

SDK - GPU Mode

RTX 3060

256

25.3522 ms

1597.44

Localization - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

615.025 ms

Localization - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

573.595 ms

Localization - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

617.739 ms

Localization - Accurate

DaoAI World Server

RTX 4080

1024

74ms

Localization - Accurate

DaoAI World Server

RTX 4080

512

62ms

Localization - Accurate

DaoAI World Server

RTX 4080

256

48ms

Localization - Accurate

SDK - GPU Mode

RTX 3060

1024

88.7166 ms

5406.72

Localization - Accurate

SDK - GPU Mode

RTX 3060

512

48.5516 ms

3809.28

Localization - Accurate

SDK - GPU Mode

RTX 3060

256

39.5805 ms

3072

Localization - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

619.68 ms

Localization - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

636.418 ms

Localization - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

569.031 ms

Localization - Rotated Accuracy

DaoAI World Server

RTX 4080

1024

106ms

Localization - Rotated Accuracy

DaoAI World Server

RTX 4080

512

91ms

Localization - Rotated Accuracy

DaoAI World Server

RTX 4080

256

71.51ms

Localization - Rotated Accuracy

SDK - GPU Mode

RTX 3060

1024

273.963 ms

5529.6

Localization - Rotated Accuracy

SDK - GPU Mode

RTX 3060

512

230.631 ms

5249.92

Localization - Rotated Accuracy

SDK - GPU Mode

RTX 3060

256

208ms

4423.68

Localization - Rotated Accuracy

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

631.068 ms

Localization - Rotated Accuracy

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

604.437 ms

Localization - Rotated Accuracy

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

626.068 ms

Presence Detection Model

Model Type

Mode Type

Hardware

Image Resolution

Inference Time

Memory Usage(Total12288)

Presence Detection - Fast

DaoAI World Server

RTX 4080

1024

36ms

Presence Detection - Fast

DaoAI World Server

RTX 4080

512

17ms

Presence Detection - Fast

DaoAI World Server

RTX 4080

256

15ms

Presence Detection - Fast

SDK - GPU Mode

RTX 3060

1024

84.2229 ms

4669

Presence Detection - Fast

SDK - GPU Mode

RTX 3060

512

30.3674 ms

2457

Presence Detection - Fast

SDK - GPU Mode

RTX 3060

256

17.2913 ms

1720

Presence Detection - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

580.068 ms

Presence Detection - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

590.727 ms

Presence Detection - Fast

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

598.02 ms

Presence Detection - Accurate

DaoAI World Server

RTX 4080

1024

32ms

Presence Detection - Accurate

DaoAI World Server

RTX 4080

512

24ms

Presence Detection - Accurate

DaoAI World Server

RTX 4080

256

23ms

Presence Detection - Accurate

SDK - GPU Mode

RTX 3060

1024

84.7263 ms

1597

Presence Detection - Accurate

SDK - GPU Mode

RTX 3060

512

40.7123 ms

860

Presence Detection - Accurate

SDK - GPU Mode

RTX 3060

256

30.9037 ms

614

Presence Detection - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

1024

621.221 ms

Presence Detection - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

512

585.791 ms

Presence Detection - Accurate

SDK - CPU Mode

Intel(R) Core(TM) i7-14700KF

256

582.264 ms

SDKAPI Documentation

More detailedSDK, Function Interfaces, data structures, etc., Please refer toSDKDocumentation:

C++ SDK API Documentation

C# SDK API Documentation

C++ Inference Client API Documentation

C# Inference Client API Documentation

Code Example

We also provide GitHub code example above, which includes C++, C# and Python example projects, to help users quickly get started and reference。

Link: DaoAI World SDK Desktop Demo