CodeProject.AI Discussions

CodeProject.AI is our standalone, self-hosted, fast, free and Open Source Artificial Intelligence microserver for any platform, any language.

README FIRST

Chris Maunder23-Apr-23 4:21

Chris Maunder

23-Apr-23 4:21

IF YOU ARE HAVING A PROBLEM

Take a look at the logs in C:\Program Files\CodeProject\AI\logs and see if there's anything in there that screams 'something broke'.
Check the FAQs in the CodeProject.AI Server documentation
Make sure you've tested the server using the Explorer (blue link, top middle of the dashboard) to ensure it's a server issue rather than something else such as Blue Iris or another app using CodeProject.AI server.
If there's no obvious answer, then copy and paste into a message the contents of the System Info tab, describe what you are doing, and what you see, and what you would expect.

Always include a copy and paste from the System Info tab of the dashboard. It gives us a ton of info on your setup. If an individual module is failing, click the 'Info' button to the right of the module's name in the status list and copy and paste that info too.

How to reinstall a module

Option 1. Go to the install modules tab on the dashboard and try re-installing the package. Make sure you have enough disk space and a reliable internet connection.

Option 2: (Option 1 with a vengeance): If that fails, head to the module's folder ([app root]\modules\module-id), open a terminal in admin mode, and run ..\..\setup. This will force a manual reinstall using the install script.

Docker: In Docker you will need to open a terminal into the docker container. You can do this using Docker Desktop, or Visual Studio Code with the Docker remote extension, or on the command using using docker attach. Then do a cd /app/modules/module-id where module-id is the id of the module you need to resinstall. Next, run sudo bash ../../setup.sh --verbosity info to force a manual reinstall of that module. (Set verbosity as quiet, info or loud to get less or more info)

cheers
Chris Maunder

modified 18-Feb-24 15:48pm.

A note on custom models and Blue Iris

Chris Maunder24-Sep-22 11:18

Chris Maunder

24-Sep-22 11:18

If you are a Blue Iris user and you are using custom models, then you would notice that the option, in Blue Iris, to set the custom model location is greyed out. This is because Blue Iris does not currently make changes to CodeProject.AI Server's settings. It can be done by manually starting CodeProject.AI with command line parameters (not a great solution), or editing the module settings files (a little messy), or setting system-wide environment variables (way easier). For version 1.6 we added an API to allow any app to change our settings programmatically, and we take care of stopping/restarting things and persisting the changes.

So: Blue Iris doesn't currently change CodeProject.AI Server's settings, so it doesn't provide you a way to change the custom model folder location from within Blue Iris.

Blue Iris will still use the contents of this folder to determine the calls it makes. If you don't specify a model to use in the Custom Models textbox, then Blue Iris will use all models in the custom models folder that it knows about.

Here we've specified a specific model to use. The Blue Iris help file explains more about how this works, including inclusive and exclusive filters on the models it finds.

CodeProject.AI Server doesn't know about Blue Iris' folder, so it can't tell what models it may be expected to use, nor can it tell Blue Iris about what models CodeProject.AI server has available. Our API allows Blue Iris to get a list of the AI models installed with CodeProject.AI Server, and also to set the folder where these models reside. But Blue Iris doesn't, yet, use that API.

So we do a hack.

At install time we sniff the registry to find where Blue Iris thinks the custom models should be. We then make empty copies of the models that we have, and copy them into that folder. If the folder doesn't exist (eg you were using C:\Program Files\CodeProject\AI\AnalysisLayer\CustomObjectDetection\assets, which no longer exists) then we create that folder, and then copy over the empty files.

When Blue Iris looks in that folder to decide what custom calls it can make, it sees the models, notes their names, and uses those names in the calls. CodeProject.AI Server has those models, so when the calls come through we can process them.

Blue Iris doesn't use the models. It uses the list of model names.

If you have your own models in the Blue Iris folder

You will need to copy them to the CodeProject.AI server's custom model folder (by default this is C:\Program Files\CodeProject\AI\AnalysisLayer\ObjectDetectionYolo\custom-models)

If you've modified the registry and have your own custom models

If you were using a folder in C:\Program Files\CodeProject\AI\AnalysisLayer\CustomObjectDetection\ (which no longer existed after the upgrade, but was recreated by our hack) you'll need to re-copy your custom model into that folder.

The simplest solutions are:

Modify the registry (Computer\HKEY_LOCAL_MACHINE\SOFTWARE\Perspective Software\Blue Iris\Options\AI, key 'deepstack_custompath') so Blue Iris looks in C:\Program Files\CodeProject\AI\AnalysisLayer\ObjectDetectionYolo\custom-models for custom models, and copy your models into there.

or
Modify C:\Program Files\CodeProject\AI\AnalysisLayer\ObjectDetectionYolo\modulesettings.json file and set CUSTOM_MODELS_DIR to be whatever Blue Iris thinks the custom model folder is.

cheers
Chris Maunder

Cannot download module and python after install

Member 162540344hrs 30mins ago

Member 16254034

4hrs 30mins ago

My setup is with BI5.
windows 11 vm with BI5, zabbix, qemu-agent client.

the web interface after install give me an error at the right.
Unable to check for updates

try reinstalling .net..
uninstall CPIA
delete folder in program file and program data.
i check in the runtime folder and nothing inside too.
try disable some feature in windows firewall and window defender.

not sure what I can do to fix this issue.

Object detection (Coral) wont detect person

Chris Huitema7hrs 11mins ago

Chris Huitema

7hrs 11mins ago

I got a USB coral today and have spent hours trying to get it working properly. Ive installed object detection (coral) 2.2.2 and have tried every model and every size. the coral itself works and is detecting, although its buggy AF, it can be reliably crashed by changing models in the explorer.. sometimes stopping and starting again fixes it but sometimes a reboot is needed.

the issue is there only seems to be 1 object returned at a time, and its always a car or a train or a plane and not a person, depending on the model and size used.. ive had almost everything except person! its really frustrating. if there is nothing but a person it will detect them. and its really inaccurate compared to YOLOv5 6.2. hand selecting images with a very very clear person in them will return person.

the YOLOv5 6.2 works flawlessly and returns everything in the image (normally double the detected objects) so person is detected and triggers the alert. ive tested multiple images and the person is detected 100% of the time. and a car is always a car not a train or plane.

i must be missing something.. why does the coral not return everything in the picture? and why is it really bad at detecting compared to the other model?

the time is definitely better, 89ms round trip on the coral vs 198ms on YOLOv5 6.2 on a CUDA GPU

For now i have to stick with the GPU and YOLOv5... hopefully the coral wasn't a total waste of money

Re: Object detection (Coral) wont detect person

mailseth25hrs 17mins ago

mailseth2

5hrs 17mins ago

For what it's worth, I haven't heard of this problem before. (USB being flakey is, however, definitely common.) I'm not sure why you'd be seeing such random results. This sounds like a problem with interpreting results and labels. What model(s) are you using? Do some models work better than others? Are you able to see the scores returned by the object detection and thresholds used? Do you have the same results when you send the images directly into the CPAI interface?

Coral module ver 2.2.2 in CPAI ver 2.6.2 errors

Steve Winn26-Apr-24 8:35

Steve Winn

26-Apr-24 8:35

@mailseth
I had tried to change the Coral model size from small to medium several days ago. It took a lot of fiddling to get the status to stop displaying CPU Tflite to TPU Tflite.

I am now looking at the log after several days being occupied with other things, and I am seeing lots and lots of these:

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\tflite_runtime\interpreter.py", line 818, in <lambda>

return lambda: self._interpreter.tensor(self._interpreter, tensor_index)

ValueError: Tensor data is null. Run allocate_tensors() first

in Object Detection (Coral)

2024-04-26 13:01:43: Response rec'd from Object Detection (Coral) command 'detect' (#reqid db3610cd-4954-4a47-af20-83141a945cc4)

2024-04-26 13:01:43: Client request 'detect' in queue 'objectdetection_queue' (#reqid 9820afcb-79e5-434c-9df9-44125fc1615c)

2024-04-26 13:01:43: Request 'detect' dequeued from 'objectdetection_queue' (#reqid 9820afcb-79e5-434c-9df9-44125fc1615c)

2024-04-26 13:01:43: Object Detection (Coral): Retrieved objectdetection_queue command 'detect' in Object Detection (Coral)

2024-04-26 13:01:43: Object Detection (Coral): [ValueError] : Traceback (most recent call last):

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py", line 182, in _do_detection

result = do_detect(opts, img, score_threshold)

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_multitpu.py", line 121, in do_detect

return odcs.do_detect(options, image, score_threshold)

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_singletpu.py", line 266, in do_detect

_, scale = common.set_resized_input(

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 95, in set_resized_input

tensor = input_tensor(interpreter)

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 65, in input_tensor

return interpreter.tensor(tensor_index)()[0]

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\tflite_runtime\interpreter.py", line 818, in <lambda>

return lambda: self._interpreter.tensor(self._interpreter, tensor_index)

ValueError: Tensor data is null. Run allocate_tensors() first

in Object Detection (Coral)

2024-04-26 13:01:43: Response rec'd from Object Detection (Coral) command 'detect' (#reqid 9820afcb-79e5-434c-9df9-44125fc1615c)

2024-04-26 13:01:44: Client request 'detect' in queue 'objectdetection_queue' (#reqid a4af2e03-edda-4496-b217-22696cb46e64)

2024-04-26 13:01:44: Request 'detect' dequeued from 'objectdetection_queue' (#reqid a4af2e03-edda-4496-b217-22696cb46e64)

2024-04-26 13:01:44: Object Detection (Coral): Retrieved objectdetection_queue command 'detect' in Object Detection (Coral)

2024-04-26 13:01:44: Object Detection (Coral): [ValueError] : Traceback (most recent call last):

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py", line 182, in _do_detection

result = do_detect(opts, img, score_threshold)

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_multitpu.py", line 121, in do_detect

return odcs.do_detect(options, image, score_threshold)

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_singletpu.py", line 266, in do_detect

_, scale = common.set_resized_input(

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 95, in set_resized_input

tensor = input_tensor(interpreter)

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 65, in input_tensor

return interpreter.tensor(tensor_index)()[0]

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\tflite_runtime\interpreter.py", line 818, in <lambda>

return lambda: self._interpreter.tensor(self._interpreter, tensor_index)

ValueError: Tensor data is null. Run allocate_tensors() first

in Object Detection (Coral)

2024-04-26 13:01:44: Response rec'd from Object Detection (Coral) command 'detect' (#reqid a4af2e03-edda-4496-b217-22696cb46e64)

2024-04-26 13:01:47: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs

I don't recall seeing anything like this before. Also lots of reverting to CPU entries as before.

I have changed back to YOLOv5 .NET. maybe it is more stable.

Again, It seems like the Coral version prior to 2.2.2 ran with next to no failed inferences, is there any way to roll back to that version in CPAI version 2.6.2, or should I try doing a complete uninstall/ reinstall of CPAI 2.6.2 and NOT upgrade the Coral module to 2.2.2?

Server version:   2.6.2
System:           Windows
Operating System: Windows (Microsoft Windows 10.0.19045)
CPUs:             Intel(R) Core(TM) i5-7500 CPU @ 3.40GHz (Intel)
                  1 CPU x 4 cores. 4 logical processors (x64)
GPU (Primary):    Intel(R) HD Graphics 630 (1,024 MiB) (Intel Corporation) 
                  Driver: 31.0.101.2111
System RAM:       16 GiB
Platform:         Windows
BuildConfig:      Release
Execution Env:    Native
Runtime Env:      Production
Runtimes installed:
  .NET runtime:     7.0.5
  .NET SDK:         Not found
  Default Python:   Not found
  Go:               Not found
  NodeJS:           Not found
  Rust:             Not found
Video adapter info:
  Intel(R) HD Graphics 630:
    Driver Version     31.0.101.2111
    Video Processor    Intel(R) HD Graphics Family
System GPU info:
  GPU 3D Usage       10%
  GPU RAM Usage      0
Global Environment variables:
  CPAI_APPROOTPATH = <root>
  CPAI_PORT        = 32168

Module 'Object Detection (Coral)' 2.2.2 (ID: ObjectDetectionCoral)
Valid:         True
Module Path:   <root>\modules\ObjectDetectionCoral
AutoStart:     True
Queue:         objectdetection_queue
Runtime:       python3.9
Runtime Loc:   Local
FilePath:      objectdetection_coral_adapter.py
Start pause:   1 sec
Parallelism:   16
LogVerbosity:  
Platforms:     all
GPU Libraries: installed if available
GPU Enabled:   enabled
Accelerator:   
Half Precis.:  enable
Environment Variables
   CPAI_CORAL_MODEL_NAME = MobileNet SSD
   CPAI_CORAL_MULTI_TPU  = True
   MODELS_DIR            = <root>\modules\ObjectDetectionCoral\assets
   MODEL_SIZE            = medium
Status Data:  {
  "inferenceDevice": "TPU",
  "inferenceLibrary": "TF-Lite",
  "canUseGPU": "false",
  "successfulInferences": 38422,
  "failedInferences": 13426,
  "numInferences": 51848,
  "averageInferenceMs": 8.628442038415491
}
Started:      24 Apr 2024 3:15:09 PM Central Standard Time
LastSeen:     26 Apr 2024 1:03:09 PM Central Standard Time
Status:       Stopped
Requests:     51850 (includes status calls)



Installation Log
2024-03-06 07:43:32:              Installing CodeProject.AI Analysis Module                
2024-03-06 07:43:32: ======================================================================
2024-03-06 07:43:32:                    CodeProject.AI Installer                           
2024-03-06 07:43:32: ======================================================================
2024-03-06 07:43:32: 302.1Gb of 487Gb available on 
2024-03-06 07:43:32: General CodeProject.AI setup                                          
2024-03-06 07:43:32: Creating Directories...Done
2024-03-06 07:43:32: GPU support                                                           
2024-03-06 07:43:33: CUDA Present...No
2024-03-06 07:43:33: ROCm Present...No
2024-03-06 07:43:35: Reading ObjectDetectionCoral settings.......Done
2024-03-06 07:43:35: Installing module Object Detection (Coral) 2.1.4                      
2024-03-06 07:43:35: Installing Python 3.9
2024-03-06 07:43:42: Downloading Python 3.9 interpreter...Expanding...Done.
2024-03-06 07:43:51: Creating Virtual Environment (Local)...Done
2024-03-06 07:43:51: Confirming we have Python 3.9 in our virtual environment...present
2024-03-06 07:43:54: Downloading edge TPU runtime...Expanding...Done.
2024-03-06 07:43:55: Copying contents of edgetpu_runtime-20221024.zip to edgetpu_runtime...done
2024-03-06 07:43:55: Installing the edge TPU libraries...
2024-03-06 07:43:55: Installing UsbDk
2024-03-06 07:43:55: Installing Windows drivers
2024-03-06 07:43:55: Microsoft PnP Utility
2024-03-06 07:43:55: Adding driver package:  coral.inf
2024-03-06 07:43:55: Driver package added successfully. (Already exists in the system)
2024-03-06 07:43:55: Published Name:         oem40.inf
2024-03-06 07:43:55: Driver package is up-to-date on device: PCI\VEN_1AC1&DEV_089A&SUBSYS_089A1AC1&REV_00\4&6ba732e&0&00D8
2024-03-06 07:43:55: Adding driver package:  Coral_USB_Accelerator.inf
2024-03-06 07:43:55: Driver package added successfully. (Already exists in the system)
2024-03-06 07:43:55: Published Name:         oem43.inf
2024-03-06 07:43:55: Driver package installed on device: USB\VID_18D1&PID_9302\5&220fb38b&0&10
2024-03-06 07:43:55: Adding driver package:  Coral_USB_Accelerator_(DFU).inf
2024-03-06 07:43:55: Driver package added successfully. (Already exists in the system)
2024-03-06 07:43:55: Published Name:         oem55.inf
2024-03-06 07:43:55: Total driver packages:  3
2024-03-06 07:43:55: Added driver packages:  2
2024-03-06 07:43:55: Installing performance counters
2024-03-06 07:43:55: Info: Provider {aaa5bf9e-c44b-4177-af65-d3a06ba45fe7} defined in C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\edgetpu_runtime\third_party\coral_accelerator_windows\coral.man is already installed in system repository.
2024-03-06 07:43:55: Info: Successfully installed performance counters in C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\edgetpu_runtime\third_party\coral_accelerator_windows\coral.manCopying edgetpu and libusb to System32
2024-03-06 07:43:55:         1 file(s) copied.
2024-03-06 07:43:55:         1 file(s) copied.
2024-03-06 07:43:55: Install complete
2024-03-06 07:44:04: Downloading EfficientDet (large) models...Expanding...Done.
2024-03-06 07:44:04: Copying contents of objectdetection-efficientdet-large-edgetpu.zip to assets...done
2024-03-06 07:44:09: Downloading EfficientDet (medium) models...Expanding...Done.
2024-03-06 07:44:10: Copying contents of objectdetection-efficientdet-medium-edgetpu.zip to assets...done
2024-03-06 07:44:15: Downloading EfficientDet (small) models...Expanding...Done.
2024-03-06 07:44:15: Copying contents of objectdetection-efficientdet-small-edgetpu.zip to assets...done
2024-03-06 07:44:19: Downloading EfficientDet (tiny) models...Expanding...Done.
2024-03-06 07:44:19: Copying contents of objectdetection-efficientdet-tiny-edgetpu.zip to assets...done
2024-03-06 07:44:35: Downloading MobileNet (large) models...Expanding...Done.
2024-03-06 07:44:36: Copying contents of objectdetection-mobilenet-large-edgetpu.zip to assets...done
2024-03-06 07:44:41: Downloading MobileNet (medium) models...Expanding...Done.
2024-03-06 07:44:41: Copying contents of objectdetection-mobilenet-medium-edgetpu.zip to assets...done
2024-03-06 07:44:49: Downloading MobileNet (small) models...Expanding...Done.
2024-03-06 07:44:49: Copying contents of objectdetection-mobilenet-small-edgetpu.zip to assets...done
2024-03-06 07:44:52: Downloading MobileNet (tiny) models...Expanding...Done.
2024-03-06 07:44:52: Copying contents of objectdetection-mobilenet-tiny-edgetpu.zip to assets...done
2024-03-06 07:45:19: Downloading YOLOv8 (large) models...Expanding...Done.
2024-03-06 07:45:19: Copying contents of objectdetection-yolov8-large-edgetpu.zip to assets...done
2024-03-06 07:45:43: Downloading YOLOv8 (medium) models...Expanding...Done.
2024-03-06 07:45:43: Copying contents of objectdetection-yolov8-medium-edgetpu.zip to assets...done
2024-03-06 07:45:49: Downloading YOLOv8 (small) models...Expanding...Done.
2024-03-06 07:45:49: Copying contents of objectdetection-yolov8-small-edgetpu.zip to assets...done
2024-03-06 07:45:51: Downloading YOLOv8 (tiny) models...Expanding...Done.
2024-03-06 07:45:51: Copying contents of objectdetection-yolov8-tiny-edgetpu.zip to assets...done
2024-03-06 07:45:51: Installing Python packages for Object Detection (Coral)
2024-03-06 07:45:51: [0;Installing GPU-enabled libraries: If available
2024-03-06 07:45:53: Ensuring Python package manager (pip) is installed...Done
2024-03-06 07:46:00: Ensuring Python package manager (pip) is up to date...Done
2024-03-06 07:46:00: Python packages specified by requirements.windows.txt
2024-03-06 07:46:03:   - Installing Pillow, a Python Image Library...(checked) Done
2024-03-06 07:46:10:   - Installing Tensorflow Lite...(checked) Done
2024-03-06 07:46:19:   - Installing PyCoral...(checked) Done
2024-03-06 07:46:39:   - Installing NumPy, a package for scientific computing...Already installed
2024-03-06 07:46:39: Installing Python packages for the CodeProject.AI Server SDK
2024-03-06 07:46:41: Ensuring Python package manager (pip) is installed...Done
2024-03-06 07:46:43: Ensuring Python package manager (pip) is up to date...Done
2024-03-06 07:46:43: Python packages specified by requirements.txt
2024-03-06 07:46:44:   - Installing Pillow, a Python Image Library...Already installed
2024-03-06 07:46:47:   - Installing Charset normalizer...(checked) Done
2024-03-06 07:46:51:   - Installing aiohttp, the Async IO HTTP library...(checked) Done
2024-03-06 07:46:53:   - Installing aiofiles, the Async IO Files library...(checked) Done
2024-03-06 07:46:56:   - Installing py-cpuinfo to allow us to query CPU info...(checked) Done
2024-03-06 07:46:59:   - Installing Requests, the HTTP library...(checked) Done
2024-03-06 07:47:01: WARNING: Logging before InitGoogleLogging() is written to STDERR
2024-03-06 07:47:01: I20240306 07:47:01.831557  6220 pipelined_model_runner.cc:171] Thread: 6220 receives empty request
2024-03-06 07:47:01: I20240306 07:47:01.831557  6220 pipelined_model_runner.cc:244] Thread: 6220 is shutting down the pipeline...
2024-03-06 07:47:01: I20240306 07:47:01.831557  8156 pipelined_model_runner.cc:206] Queue is empty and `StopWaiters()` is called.
2024-03-06 07:47:01: I20240306 07:47:01.831557  6220 pipelined_model_runner.cc:254] Thread: 6220 Pipeline is off.
2024-03-06 07:47:01: I20240306 07:47:01.831557  6220 pipelined_model_runner.cc:171] Thread: 6220 receives empty request
2024-03-06 07:47:01: E20240306 07:47:01.831557  6220 pipelined_model_runner.cc:239] Thread: 6220 Pipeline was turned off before.
2024-03-06 07:47:01: I20240306 07:47:01.831557  6220 pipelined_model_runner.cc:206] Queue is empty and `StopWaiters()` is called.
2024-03-06 07:47:01: E20240306 07:47:01.831557  6220 pipelined_model_runner.cc:239] Thread: 6220 Pipeline was turned off before.
2024-03-06 07:47:01: E20240306 07:47:01.831557  6220 pipelined_model_runner.cc:146] Failed to shutdown status: INTERNAL: Pipeline was turned off before.
2024-03-06 07:47:01: I20240306 07:47:01.957798  6220 pipelined_model_runner.cc:171] Thread: 6220 receives empty request
2024-03-06 07:47:01: I20240306 07:47:01.957798  6220 pipelined_model_runner.cc:244] Thread: 6220 is shutting down the pipeline...
2024-03-06 07:47:01: I20240306 07:47:01.957798  6220 pipelined_model_runner.cc:254] Thread: 6220 Pipeline is off.
2024-03-06 07:47:01: I20240306 07:47:01.957798 10996 pipelined_model_runner.cc:206] Queue is empty and `StopWaiters()` is called.
2024-03-06 07:47:01: I20240306 07:47:01.958794  6220 pipelined_model_runner.cc:171] Thread: 6220 receives empty request
2024-03-06 07:47:01: E20240306 07:47:01.958794  6220 pipelined_model_runner.cc:239] Thread: 6220 Pipeline was turned off before.
2024-03-06 07:47:01: I20240306 07:47:01.958794  6220 pipelined_model_runner.cc:206] Queue is empty and `StopWaiters()` is called.
2024-03-06 07:47:01: E20240306 07:47:01.958794  6220 pipelined_model_runner.cc:239] Thread: 6220 Pipeline was turned off before.
2024-03-06 07:47:01: E20240306 07:47:01.958794  6220 pipelined_model_runner.cc:146] Failed to shutdown status: INTERNAL: Pipeline was turned off before.
2024-03-06 07:47:06: Self test: Self-test passed
2024-03-06 07:47:06: Module setup time 00:03:33.38
2024-03-06 07:47:06: Setup complete                                                        
2024-03-06 07:47:06: Total setup time 00:03:34.29
Installer exited with code 0
2024-03-15 14:56:30:              Installing CodeProject.AI Analysis Module                
2024-03-15 14:56:30: ======================================================================
2024-03-15 14:56:30:                    CodeProject.AI Installer                           
2024-03-15 14:56:30: ======================================================================
2024-03-15 14:56:30: 302.5Gb of 487Gb available on 
2024-03-15 14:56:30: General CodeProject.AI setup                                          
2024-03-15 14:56:30: Creating Directories...Done
2024-03-15 14:56:30: GPU support                                                           
2024-03-15 14:56:31: CUDA Present...No
2024-03-15 14:56:31: ROCm Present...No
2024-03-15 14:56:34: Reading ObjectDetectionCoral settings.......Done
2024-03-15 14:56:34: Installing module Object Detection (Coral) 2.1.5                      
2024-03-15 14:56:34: Installing Python 3.9
2024-03-15 14:56:34: Python 3.9 is already installed
2024-03-15 14:56:34: Creating Virtual Environment (Local)...Virtual Environment already present
2024-03-15 14:56:34: Confirming we have Python 3.9 in our virtual environment...present
2024-03-15 14:56:34: Installing the edge TPU libraries...
2024-03-15 14:56:34: Installing UsbDk
2024-03-15 14:56:35: Installing Windows drivers
2024-03-15 14:56:35: Microsoft PnP Utility
2024-03-15 14:56:35: Adding driver package:  coral.inf
2024-03-15 14:56:35: Driver package added successfully. (Already exists in the system)
2024-03-15 14:56:35: Published Name:         oem40.inf
2024-03-15 14:56:35: Driver package is up-to-date on device: PCI\VEN_1AC1&DEV_089A&SUBSYS_089A1AC1&REV_00\4&6ba732e&0&00D8
2024-03-15 14:56:35: Adding driver package:  Coral_USB_Accelerator.inf
2024-03-15 14:56:35: Driver package added successfully. (Already exists in the system)
2024-03-15 14:56:35: Published Name:         oem43.inf
2024-03-15 14:56:35: Driver package installed on device: USB\VID_18D1&PID_9302\5&220fb38b&0&10
2024-03-15 14:56:35: Adding driver package:  Coral_USB_Accelerator_(DFU).inf
2024-03-15 14:56:35: Driver package added successfully. (Already exists in the system)
2024-03-15 14:56:35: Published Name:         oem55.inf
2024-03-15 14:56:35: Total driver packages:  3
2024-03-15 14:56:35: Added driver packages:  2
2024-03-15 14:56:35: Installing performance counters
2024-03-15 14:56:35: Info: Provider {aaa5bf9e-c44b-4177-af65-d3a06ba45fe7} defined in C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\edgetpu_runtime\third_party\coral_accelerator_windows\coral.man is already installed in system repository.
2024-03-15 14:56:35: Info: Successfully installed performance counters in C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\edgetpu_runtime\third_party\coral_accelerator_windows\coral.manCopying edgetpu and libusb to System32
2024-03-15 14:56:35: The process cannot access the file because it is being used by another process.
2024-03-15 14:56:35:         0 file(s) copied.
2024-03-15 14:56:35: The process cannot access the file because it is being used by another process.
2024-03-15 14:56:35:         0 file(s) copied.
2024-03-15 14:56:35: Install complete
2024-03-15 14:56:36: Downloading EfficientDet (large) models...already exists...Expanding...Done.
2024-03-15 14:56:36: Copying contents of objectdetection-efficientdet-large-edgetpu.zip to assets...done
2024-03-15 14:56:36: Downloading EfficientDet (medium) models...already exists...Expanding...Done.
2024-03-15 14:56:36: Copying contents of objectdetection-efficientdet-medium-edgetpu.zip to assets...done
2024-03-15 14:56:36: Downloading EfficientDet (small) models...already exists...Expanding...Done.
2024-03-15 14:56:37: Copying contents of objectdetection-efficientdet-small-edgetpu.zip to assets...done
2024-03-15 14:56:37: Downloading EfficientDet (tiny) models...already exists...Expanding...Done.
2024-03-15 14:56:37: Copying contents of objectdetection-efficientdet-tiny-edgetpu.zip to assets...done
2024-03-15 14:56:38: Downloading MobileNet (large) models...already exists...Expanding...Done.
2024-03-15 14:56:38: Copying contents of objectdetection-mobilenet-large-edgetpu.zip to assets...done
2024-03-15 14:56:38: Downloading MobileNet (medium) models...already exists...Expanding...Done.
2024-03-15 14:56:38: Copying contents of objectdetection-mobilenet-medium-edgetpu.zip to assets...done
2024-03-15 14:56:38: Downloading MobileNet (small) models...already exists...Expanding...Done.
2024-03-15 14:56:38: Copying contents of objectdetection-mobilenet-small-edgetpu.zip to assets...done
2024-03-15 14:56:39: Downloading MobileNet (tiny) models...already exists...Expanding...Done.
2024-03-15 14:56:39: Copying contents of objectdetection-mobilenet-tiny-edgetpu.zip to assets...done
2024-03-15 14:56:40: Downloading YOLOv8 (large) models...already exists...Expanding...Done.
2024-03-15 14:56:40: Copying contents of objectdetection-yolov8-large-edgetpu.zip to assets...done
2024-03-15 14:56:41: Downloading YOLOv8 (medium) models...already exists...Expanding...Done.
2024-03-15 14:56:41: Copying contents of objectdetection-yolov8-medium-edgetpu.zip to assets...done
2024-03-15 14:56:41: Downloading YOLOv8 (small) models...already exists...Expanding...Done.
2024-03-15 14:56:41: Copying contents of objectdetection-yolov8-small-edgetpu.zip to assets...done
2024-03-15 14:56:42: Downloading YOLOv8 (tiny) models...already exists...Expanding...Done.
2024-03-15 14:56:42: Copying contents of objectdetection-yolov8-tiny-edgetpu.zip to assets...done
2024-03-15 14:56:42: Installing Python packages for Object Detection (Coral)
2024-03-15 14:56:42: [0;Installing GPU-enabled libraries: If available
2024-03-15 14:56:44: Ensuring Python package manager (pip) is installed...Done
2024-03-15 14:57:29: Ensuring Python package manager (pip) is up to date...Done
2024-03-15 14:57:29: Python packages specified by requirements.windows.txt
2024-03-15 14:57:30:   - Installing Pillow, a Python Image Library...Already installed
2024-03-15 14:57:30:   - Installing Tensorflow Lite...Already installed
2024-03-15 14:57:31:   - Installing PyCoral...Already installed
2024-03-15 14:57:49:   - Installing NumPy, a package for scientific computing...Already installed
2024-03-15 14:57:49: Installing Python packages for the CodeProject.AI Server SDK
2024-03-15 14:57:51: Ensuring Python package manager (pip) is installed...Done
2024-03-15 14:57:53: Ensuring Python package manager (pip) is up to date...Done
2024-03-15 14:57:53: Python packages specified by requirements.txt
2024-03-15 14:57:54:   - Installing Pillow, a Python Image Library...Already installed
2024-03-15 14:57:55:   - Installing Charset normalizer...Already installed
2024-03-15 14:57:56:   - Installing aiohttp, the Async IO HTTP library...Already installed
2024-03-15 14:57:57:   - Installing aiofiles, the Async IO Files library...Already installed
2024-03-15 14:57:58:   - Installing py-cpuinfo to allow us to query CPU info...Already installed
2024-03-15 14:57:59:   - Installing Requests, the HTTP library...Already installed
2024-03-15 14:58:01: ERROR:root:Unable to create interpreter for TPU pci:0: Failed to load delegate from edgetpu.dll
2024-03-15 14:58:01: WARNING:root:Unable to create interpreter for CPU using edgeTPU library: Failed to load delegate from edgetpu.dll
2024-04-04 10:42:29:              Installing CodeProject.AI Analysis Module                
2024-04-04 10:42:29: ======================================================================
2024-04-04 10:42:29:                    CodeProject.AI Installer                           
2024-04-04 10:42:29: ======================================================================
2024-04-04 10:42:29: 301.7Gb of 487Gb available on 
2024-04-04 10:42:29: General CodeProject.AI setup                                          
2024-04-04 10:42:29: Creating Directories...done
2024-04-04 10:42:29: GPU support                                                           
2024-04-04 10:42:30: CUDA Present...No
2024-04-04 10:42:30: ROCm Present...No
2024-04-04 10:42:32: Reading ObjectDetectionCoral settings.......done
2024-04-04 10:42:32: Installing module Object Detection (Coral) 2.2.0                      
2024-04-04 10:42:32: Installing Python 3.9
2024-04-04 10:42:32: Python 3.9 is already installed
2024-04-04 10:42:32: Creating Virtual Environment (Local)...Virtual Environment already present
2024-04-04 10:42:32: Confirming we have Python 3.9 in our virtual environment...present
2024-04-04 10:42:33: Installing the edge TPU libraries...
2024-04-04 10:42:33: Installing UsbDk
2024-04-04 10:42:33: Installing Windows drivers
2024-04-04 10:42:33: Microsoft PnP Utility
2024-04-04 10:42:33: Adding driver package:  coral.inf
2024-04-04 10:42:33: Driver package added successfully. (Already exists in the system)
2024-04-04 10:42:33: Published Name:         oem40.inf
2024-04-04 10:42:33: Driver package is up-to-date on device: PCI\VEN_1AC1&DEV_089A&SUBSYS_089A1AC1&REV_00\4&6ba732e&0&00D8
2024-04-04 10:42:33: Adding driver package:  Coral_USB_Accelerator.inf
2024-04-04 10:42:33: Driver package added successfully. (Already exists in the system)
2024-04-04 10:42:33: Published Name:         oem43.inf
2024-04-04 10:42:33: Driver package installed on device: USB\VID_18D1&PID_9302\5&220fb38b&0&10
2024-04-04 10:42:33: Adding driver package:  Coral_USB_Accelerator_(DFU).inf
2024-04-04 10:42:33: Driver package added successfully. (Already exists in the system)
2024-04-04 10:42:33: Published Name:         oem55.inf
2024-04-04 10:42:33: Total driver packages:  3
2024-04-04 10:42:33: Added driver packages:  2
2024-04-04 10:42:33: Installing performance counters
2024-04-04 10:42:34: Info: Provider {aaa5bf9e-c44b-4177-af65-d3a06ba45fe7} defined in C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\edgetpu_runtime\third_party\coral_accelerator_windows\coral.man is already installed in system repository.
2024-04-04 10:42:34: Info: Successfully installed performance counters in C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\edgetpu_runtime\third_party\coral_accelerator_windows\coral.manCopying edgetpu and libusb to System32
2024-04-04 10:42:34: The process cannot access the file because it is being used by another process.
2024-04-04 10:42:34:         0 file(s) copied.
2024-04-04 10:42:34: The process cannot access the file because it is being used by another process.
2024-04-04 10:42:34:         0 file(s) copied.
2024-04-04 10:42:34: Install complete
2024-04-04 10:42:41: Downloading EfficientDet (large) models...Expanding...done.
2024-04-04 10:42:41: Copying contents of objectdetection-efficientdet-large-edgetpu.zip to assets...done
2024-04-04 10:42:46: Downloading EfficientDet (medium) models...Expanding...done.
2024-04-04 10:42:46: Copying contents of objectdetection-efficientdet-medium-edgetpu.zip to assets...done
2024-04-04 10:42:51: Downloading EfficientDet (small) models...Expanding...done.
2024-04-04 10:42:52: Copying contents of objectdetection-efficientdet-small-edgetpu.zip to assets...done
2024-04-04 10:42:55: Downloading EfficientDet (tiny) models...Expanding...done.
2024-04-04 10:42:55: Copying contents of objectdetection-efficientdet-tiny-edgetpu.zip to assets...done
2024-04-04 10:43:08: Downloading MobileNet (large) models...Expanding...done.
2024-04-04 10:43:08: Copying contents of objectdetection-mobilenet-large-edgetpu.zip to assets...done
2024-04-04 10:43:14: Downloading MobileNet (medium) models...Expanding...done.
2024-04-04 10:43:15: Copying contents of objectdetection-mobilenet-medium-edgetpu.zip to assets...done
2024-04-04 10:43:27: Downloading MobileNet (small) models...Expanding...done.
2024-04-04 10:43:27: Copying contents of objectdetection-mobilenet-small-edgetpu.zip to assets...done
2024-04-04 10:43:33: Downloading MobileNet (tiny) models...Expanding...done.
2024-04-04 10:43:33: Copying contents of objectdetection-mobilenet-tiny-edgetpu.zip to assets...done
2024-04-04 10:43:50: Downloading YOLOv8 (large) models...Expanding...done.
2024-04-04 10:43:51: Copying contents of objectdetection-yolov8-large-edgetpu.zip to assets...done
2024-04-04 10:44:03: Downloading YOLOv8 (medium) models...Expanding...done.
2024-04-04 10:44:03: Copying contents of objectdetection-yolov8-medium-edgetpu.zip to assets...done
2024-04-04 10:44:07: Downloading YOLOv8 (small) models...Expanding...done.
2024-04-04 10:44:08: Copying contents of objectdetection-yolov8-small-edgetpu.zip to assets...done
2024-04-04 10:44:10: Downloading YOLOv8 (tiny) models...Expanding...done.
2024-04-04 10:44:10: Copying contents of objectdetection-yolov8-tiny-edgetpu.zip to assets...done
2024-04-04 10:44:10: Installing Python packages for Object Detection (Coral)
2024-04-04 10:44:10: [0;Installing GPU-enabled libraries: If available
2024-04-04 10:44:12: Ensuring Python package manager (pip) is installed...done
2024-04-04 10:44:15: Ensuring Python package manager (pip) is up to date...done
2024-04-04 10:44:15: Python packages specified by requirements.windows.txt
2024-04-04 10:44:16:   - Installing Pillow, a Python Image Library...Already installed
2024-04-04 10:44:17:   - Installing Tensorflow Lite...Already installed
2024-04-04 10:44:17:   - Installing PyCoral...Already installed
2024-04-04 10:44:36:   - Installing NumPy, a package for scientific computing...Already installed
2024-04-04 10:44:36: Installing Python packages for the CodeProject.AI Server SDK
2024-04-04 10:44:38: Ensuring Python package manager (pip) is installed...done
2024-04-04 10:44:40: Ensuring Python package manager (pip) is up to date...done
2024-04-04 10:44:40: Python packages specified by requirements.txt
2024-04-04 10:44:41:   - Installing Pillow, a Python Image Library...Already installed
2024-04-04 10:44:42:   - Installing Charset normalizer...Already installed
2024-04-04 10:44:43:   - Installing aiohttp, the Async IO HTTP library...Already installed
2024-04-04 10:44:44:   - Installing aiofiles, the Async IO Files library...Already installed
2024-04-04 10:44:45:   - Installing py-cpuinfo to allow us to query CPU info...Already installed
2024-04-04 10:44:46:   - Installing Requests, the HTTP library...Already installed
2024-04-04 10:44:49: Scanning modulesettings for downloadable models...Processing model list
2024-04-04 10:44:50: Downloading MobileNet Large...already exists...Expanding...done.
2024-04-04 10:44:50: Copying contents of objectdetection-mobilenet-large-edgetpu.zip to assets...done
2024-04-04 10:44:51: Downloading MobileNet Medium...already exists...Expanding...done.
2024-04-04 10:44:51: Copying contents of objectdetection-mobilenet-medium-edgetpu.zip to assets...done
2024-04-04 10:44:53: Downloading MobileNet Small...already exists...Expanding...done.
2024-04-04 10:44:53: Copying contents of objectdetection-mobilenet-small-edgetpu.zip to assets...done
2024-04-04 10:44:54: Downloading MobileNet Tiny...already exists...Expanding...done.
2024-04-04 10:44:54: Copying contents of objectdetection-mobilenet-tiny-edgetpu.zip to assets...done
2024-04-04 10:45:05: Self test: Self-test passed
2024-04-04 10:45:06: Module setup time 00:02:35.53
2024-04-04 10:45:06: Setup complete                                                        
2024-04-04 10:45:06: Total setup time 00:02:36.70
Installer exited with code 0
2024-04-21 07:35:18:              Installing CodeProject.AI Analysis Module                
2024-04-21 07:35:18: ======================================================================
2024-04-21 07:35:18:                    CodeProject.AI Installer                           
2024-04-21 07:35:18: ======================================================================
2024-04-21 07:35:18: 304.1Gb of 487Gb available on 
2024-04-21 07:35:18: os, arch             = windows x86_64
2024-04-21 07:35:18: systemName, platform = Windows, windows
2024-04-21 07:35:19: edgeDevice           = 
2024-04-21 07:35:19: setupMode            = SetupModule
2024-04-21 07:35:19: executionEnvironment = Production
2024-04-21 07:35:19: rootDirPath          = C:\Program Files\CodeProject\AI
2024-04-21 07:35:19: appRootDirPath       = C:\Program Files\CodeProject\AI\
2024-04-21 07:35:19: setupScriptDirPath   = C:\Program Files\CodeProject\AI\
2024-04-21 07:35:19: sdkScriptsDirPath    = C:\Program Files\CodeProject\AI\SDK\Scripts
2024-04-21 07:35:19: runtimesDirPath      = C:\Program Files\CodeProject\AI\runtimes
2024-04-21 07:35:19: modulesDirPath       = C:\Program Files\CodeProject\AI\modules
2024-04-21 07:35:19: downloadDirPath      = C:\Program Files\CodeProject\AI\downloads
2024-04-21 07:35:19: General CodeProject.AI setup                                          
2024-04-21 07:35:19: Creating Directories...done
2024-04-21 07:35:19: GPU support                                                           
2024-04-21 07:35:20: CUDA Present...No
2024-04-21 07:35:20: ROCm Present...No
2024-04-21 07:35:20: Reading ObjectDetectionCoral settingsUsed modulesettings.json to get value Object Detection (Coral)
2024-04-21 07:35:21: .Used modulesettings.json to get value 2.2.2
2024-04-21 07:35:21: .Used modulesettings.windows.json to get value python3.9
2024-04-21 07:35:21: .Used modulesettings.json to get value Local
2024-04-21 07:35:22: .Used modulesettings.json to get value objectdetection_coral_adapter.py
2024-04-21 07:35:22: .Used modulesettings.json to get value true
2024-04-21 07:35:22: .Used modulesettings.json to get value ["all"]
2024-04-21 07:35:22: .done
2024-04-21 07:35:22: Installing module Object Detection (Coral) 2.2.2                      
2024-04-21 07:35:22: Variable Dump                                                         
2024-04-21 07:35:22: moduleName          = Object Detection (Coral)
2024-04-21 07:35:22: moduleVersion       = 2.2.2
2024-04-21 07:35:22: runtime             = python3.9
2024-04-21 07:35:22: runtimeLocation     = Local
2024-04-21 07:35:22: installGPU          = true
2024-04-21 07:35:22: pythonVersion       = 3.9
2024-04-21 07:35:22: virtualEnvDirPath   = C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv
2024-04-21 07:35:23: venvPythonCmdPath   = C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\Scripts\python.exe
2024-04-21 07:35:23: packagesDirPath     = C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\Lib\site-packages
2024-04-21 07:35:23: moduleStartFilePath = objectdetection_coral_adapter.py
2024-04-21 07:35:23: Installing Python 3.9
2024-04-21 07:35:23: Installing python39 in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python39
2024-04-21 07:35:23: Python 3.9 is already installed
2024-04-21 07:35:23: Creating Virtual Environment (Local)...Virtual Environment already present
2024-04-21 07:35:23: Confirming we have Python 3.9 in our virtual environment...present
2024-04-21 07:35:23: Installing the edge TPU libraries...
2024-04-21 07:35:23: Installing UsbDk
2024-04-21 07:35:24: Installing Windows drivers
2024-04-21 07:35:24: Microsoft PnP Utility
2024-04-21 07:35:24: Adding driver package:  coral.inf
2024-04-21 07:35:24: Driver package added successfully. (Already exists in the system)
2024-04-21 07:35:24: Published Name:         oem40.inf
2024-04-21 07:35:24: Driver package is up-to-date on device: PCI\VEN_1AC1&DEV_089A&SUBSYS_089A1AC1&REV_00\4&6ba732e&0&00D8
2024-04-21 07:35:24: Adding driver package:  Coral_USB_Accelerator.inf
2024-04-21 07:35:24: Driver package added successfully. (Already exists in the system)
2024-04-21 07:35:24: Published Name:         oem43.inf
2024-04-21 07:35:24: Driver package installed on device: USB\VID_18D1&PID_9302\5&220fb38b&0&10
2024-04-21 07:35:24: Adding driver package:  Coral_USB_Accelerator_(DFU).inf
2024-04-21 07:35:24: Driver package added successfully. (Already exists in the system)
2024-04-21 07:35:24: Published Name:         oem55.inf
2024-04-21 07:35:24: Total driver packages:  3
2024-04-21 07:35:24: Added driver packages:  2
2024-04-21 07:35:24: Installing performance counters
2024-04-21 07:35:24: Info: Provider {aaa5bf9e-c44b-4177-af65-d3a06ba45fe7} defined in C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\edgetpu_runtime\third_party\coral_accelerator_windows\coral.man is already installed in system repository.
2024-04-21 07:35:24: Info: Successfully installed performance counters in C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\edgetpu_runtime\third_party\coral_accelerator_windows\coral.manCopying edgetpu and libusb to System32
2024-04-21 07:35:24:         1 file(s) copied.
2024-04-21 07:35:24:         1 file(s) copied.
2024-04-21 07:35:24: Install complete
2024-04-21 07:35:24: Downloading objectdetection-efficientdet-large-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:24: Downloading EfficientDet (large) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-efficientdet-large-edgetpu.zip'
2024-04-21 07:35:24: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:24: Extracting objectdetection-efficientdet-large-edgetpu.zip
2024-04-21 07:35:25: done.
2024-04-21 07:35:25: Copying contents of objectdetection-efficientdet-large-edgetpu.zip to assets...done
2024-04-21 07:35:25: Downloading objectdetection-efficientdet-medium-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:25: Downloading EfficientDet (medium) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-efficientdet-medium-edgetpu.zip'
2024-04-21 07:35:25: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:25: Extracting objectdetection-efficientdet-medium-edgetpu.zip
2024-04-21 07:35:25: done.
2024-04-21 07:35:25: Copying contents of objectdetection-efficientdet-medium-edgetpu.zip to assets...done
2024-04-21 07:35:25: Downloading objectdetection-efficientdet-small-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:25: Downloading EfficientDet (small) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-efficientdet-small-edgetpu.zip'
2024-04-21 07:35:25: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:25: Extracting objectdetection-efficientdet-small-edgetpu.zip
2024-04-21 07:35:26: done.
2024-04-21 07:35:26: Copying contents of objectdetection-efficientdet-small-edgetpu.zip to assets...done
2024-04-21 07:35:26: Downloading objectdetection-efficientdet-tiny-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:26: Downloading EfficientDet (tiny) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-efficientdet-tiny-edgetpu.zip'
2024-04-21 07:35:26: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:26: Extracting objectdetection-efficientdet-tiny-edgetpu.zip
2024-04-21 07:35:26: done.
2024-04-21 07:35:26: Copying contents of objectdetection-efficientdet-tiny-edgetpu.zip to assets...done
2024-04-21 07:35:26: Downloading objectdetection-mobilenet-large-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:26: Downloading MobileNet (large) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-mobilenet-large-edgetpu.zip'
2024-04-21 07:35:26: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:26: Extracting objectdetection-mobilenet-large-edgetpu.zip
2024-04-21 07:35:27: done.
2024-04-21 07:35:27: Copying contents of objectdetection-mobilenet-large-edgetpu.zip to assets...done
2024-04-21 07:35:27: Downloading objectdetection-mobilenet-medium-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:27: Downloading MobileNet (medium) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-mobilenet-medium-edgetpu.zip'
2024-04-21 07:35:27: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:27: Extracting objectdetection-mobilenet-medium-edgetpu.zip
2024-04-21 07:35:27: done.
2024-04-21 07:35:28: Copying contents of objectdetection-mobilenet-medium-edgetpu.zip to assets...done
2024-04-21 07:35:28: Downloading objectdetection-mobilenet-small-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:28: Downloading MobileNet (small) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-mobilenet-small-edgetpu.zip'
2024-04-21 07:35:28: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:28: Extracting objectdetection-mobilenet-small-edgetpu.zip
2024-04-21 07:35:28: done.
2024-04-21 07:35:28: Copying contents of objectdetection-mobilenet-small-edgetpu.zip to assets...done
2024-04-21 07:35:28: Downloading objectdetection-mobilenet-tiny-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:28: Downloading MobileNet (tiny) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-mobilenet-tiny-edgetpu.zip'
2024-04-21 07:35:28: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:28: Extracting objectdetection-mobilenet-tiny-edgetpu.zip
2024-04-21 07:35:28: done.
2024-04-21 07:35:29: Copying contents of objectdetection-mobilenet-tiny-edgetpu.zip to assets...done
2024-04-21 07:35:29: Downloading objectdetection-yolov8-large-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:29: Downloading YOLOv8 (large) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-yolov8-large-edgetpu.zip'
2024-04-21 07:35:29: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:29: Extracting objectdetection-yolov8-large-edgetpu.zip
2024-04-21 07:35:30: done.
2024-04-21 07:35:30: Copying contents of objectdetection-yolov8-large-edgetpu.zip to assets...done
2024-04-21 07:35:30: Downloading objectdetection-yolov8-medium-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:30: Downloading YOLOv8 (medium) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-yolov8-medium-edgetpu.zip'
2024-04-21 07:35:30: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:30: Extracting objectdetection-yolov8-medium-edgetpu.zip
2024-04-21 07:35:31: done.
2024-04-21 07:35:31: Copying contents of objectdetection-yolov8-medium-edgetpu.zip to assets...done
2024-04-21 07:35:31: Downloading objectdetection-yolov8-small-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:31: Downloading YOLOv8 (small) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-yolov8-small-edgetpu.zip'
2024-04-21 07:35:31: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:31: Extracting objectdetection-yolov8-small-edgetpu.zip
2024-04-21 07:35:31: done.
2024-04-21 07:35:31: Copying contents of objectdetection-yolov8-small-edgetpu.zip to assets...done
2024-04-21 07:35:32: Downloading objectdetection-yolov8-tiny-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:35:32: Downloading YOLOv8 (tiny) models...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-yolov8-tiny-edgetpu.zip'
2024-04-21 07:35:32: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:35:32: Extracting objectdetection-yolov8-tiny-edgetpu.zip
2024-04-21 07:35:32: done.
2024-04-21 07:35:32: Copying contents of objectdetection-yolov8-tiny-edgetpu.zip to assets...done
2024-04-21 07:35:32: Installing Python packages for Object Detection (Coral)
2024-04-21 07:35:32: [0;Installing GPU-enabled libraries: If available
2024-04-21 07:35:34: Ensuring Python package manager (pip) is installed...Looking in links: c:\Windows\TEMP\tmp97euq9zj
2024-04-21 07:35:34: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\modules\objectdetectioncoral\bin\windows\python39\venv\lib\site-packages (69.2.0)
2024-04-21 07:35:34: Requirement already satisfied: pip in c:\program files\codeproject\ai\modules\objectdetectioncoral\bin\windows\python39\venv\lib\site-packages (24.0)
2024-04-21 07:35:34: done
2024-04-21 07:35:35: Ensuring Python package manager (pip) is up to date...Requirement already satisfied: setuptools in c:\program files\codeproject\ai\modules\objectdetectioncoral\bin\windows\python39\venv\lib\site-packages (69.2.0)
2024-04-21 07:35:36: Collecting setuptools
2024-04-21 07:35:36:   Downloading setuptools-69.5.1-py3-none-any.whl.metadata (6.2 kB)
2024-04-21 07:35:36: Downloading setuptools-69.5.1-py3-none-any.whl (894 kB)
2024-04-21 07:35:36:    ---------------------------------------- 894.6/894.6 kB 6.3 MB/s eta 0:00:00
2024-04-21 07:35:36: Installing collected packages: setuptools
2024-04-21 07:35:36:   Attempting uninstall: setuptools
2024-04-21 07:35:36:     Found existing installation: setuptools 69.2.0
2024-04-21 07:35:37:     Uninstalling setuptools-69.2.0:
2024-04-21 07:35:37:       Successfully uninstalled setuptools-69.2.0
2024-04-21 07:35:38: Successfully installed setuptools-69.5.1
2024-04-21 07:35:39: Requirement already satisfied: pip in c:\program files\codeproject\ai\modules\objectdetectioncoral\bin\windows\python39\venv\lib\site-packages (24.0)
2024-04-21 07:35:39: done
2024-04-21 07:35:39: Requirements Search Path is C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
2024-04-21 07:35:39: Searching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
2024-04-21 07:35:39: Python packages specified by requirements.windows.txt
2024-04-21 07:35:39: Choosing Python packages from C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\requirements.windows.txt
2024-04-21 07:35:40:   - Installing Pillow, a Python Image Library...Already installed
2024-04-21 07:35:41:   - Installing Tensorflow Lite...Already installed
2024-04-21 07:35:42:   - Installing PyCoral...Already installed
2024-04-21 07:35:59:   - Installing NumPy, a package for scientific computing...Already installed
2024-04-21 07:36:00: Installing Python packages for the CodeProject.AI Server SDK
2024-04-21 07:36:01: Ensuring Python package manager (pip) is installed...Looking in links: c:\Windows\TEMP\tmpoz0mfidn
2024-04-21 07:36:01: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\modules\objectdetectioncoral\bin\windows\python39\venv\lib\site-packages (69.5.1)
2024-04-21 07:36:01: Requirement already satisfied: pip in c:\program files\codeproject\ai\modules\objectdetectioncoral\bin\windows\python39\venv\lib\site-packages (24.0)
2024-04-21 07:36:01: done
2024-04-21 07:36:01: Ensuring Python package manager (pip) is up to date...Requirement already satisfied: setuptools in c:\program files\codeproject\ai\modules\objectdetectioncoral\bin\windows\python39\venv\lib\site-packages (69.5.1)
2024-04-21 07:36:03: Requirement already satisfied: pip in c:\program files\codeproject\ai\modules\objectdetectioncoral\bin\windows\python39\venv\lib\site-packages (24.0)
2024-04-21 07:36:03: done
2024-04-21 07:36:03: Requirements Search Path is C:\Program Files\CodeProject\AI\SDK\Python
2024-04-21 07:36:03: Searching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\SDK\Python
2024-04-21 07:36:03: Python packages specified by requirements.txt
2024-04-21 07:36:03: Choosing Python packages from C:\Program Files\CodeProject\AI\SDK\Python\requirements.txt
2024-04-21 07:36:04:   - Installing Pillow, a Python Image Library...Already installed
2024-04-21 07:36:05:   - Installing Charset normalizer...Already installed
2024-04-21 07:36:06:   - Installing aiohttp, the Async IO HTTP library...Already installed
2024-04-21 07:36:07:   - Installing aiofiles, the Async IO Files library...Already installed
2024-04-21 07:36:08:   - Installing py-cpuinfo to allow us to query CPU info...Already installed
2024-04-21 07:36:09:   - Installing Requests, the HTTP library...Already installed
2024-04-21 07:36:09: Scanning modulesettings for downloadable models...Used modulesettings.json to get value MobileNet Large
2024-04-21 07:36:09: Used modulesettings.json to get value true
2024-04-21 07:36:09: Processing model list
2024-04-21 07:36:10: Used modulesettings.json to get value objectdetection-mobilenet-large-edgetpu.zip
2024-04-21 07:36:10: Used modulesettings.json to get value assets
2024-04-21 07:36:10: Downloading objectdetection-mobilenet-large-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:36:10: Downloading MobileNet Large...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-mobilenet-large-edgetpu.zip'
2024-04-21 07:36:10: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:36:10: Extracting objectdetection-mobilenet-large-edgetpu.zip
2024-04-21 07:36:11: done.
2024-04-21 07:36:11: Copying contents of objectdetection-mobilenet-large-edgetpu.zip to assets...done
2024-04-21 07:36:11: Used modulesettings.json to get value MobileNet Medium
2024-04-21 07:36:11: Used modulesettings.json to get value true
2024-04-21 07:36:11: Used modulesettings.json to get value objectdetection-mobilenet-medium-edgetpu.zip
2024-04-21 07:36:12: Used modulesettings.json to get value assets
2024-04-21 07:36:12: Downloading objectdetection-mobilenet-medium-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:36:12: Downloading MobileNet Medium...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-mobilenet-medium-edgetpu.zip'
2024-04-21 07:36:12: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:36:12: Extracting objectdetection-mobilenet-medium-edgetpu.zip
2024-04-21 07:36:12: done.
2024-04-21 07:36:12: Copying contents of objectdetection-mobilenet-medium-edgetpu.zip to assets...done
2024-04-21 07:36:12: Used modulesettings.json to get value MobileNet Small
2024-04-21 07:36:13: Used modulesettings.json to get value true
2024-04-21 07:36:13: Used modulesettings.json to get value objectdetection-mobilenet-small-edgetpu.zip
2024-04-21 07:36:13: Used modulesettings.json to get value assets
2024-04-21 07:36:13: Downloading objectdetection-mobilenet-small-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:36:13: Downloading MobileNet Small...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-mobilenet-small-edgetpu.zip'
2024-04-21 07:36:13: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:36:13: Extracting objectdetection-mobilenet-small-edgetpu.zip
2024-04-21 07:36:14: done.
2024-04-21 07:36:14: Copying contents of objectdetection-mobilenet-small-edgetpu.zip to assets...done
2024-04-21 07:36:14: Used modulesettings.json to get value MobileNet Tiny
2024-04-21 07:36:14: Used modulesettings.json to get value true
2024-04-21 07:36:14: Used modulesettings.json to get value objectdetection-mobilenet-tiny-edgetpu.zip
2024-04-21 07:36:15: Used modulesettings.json to get value assets
2024-04-21 07:36:15: Downloading objectdetection-mobilenet-tiny-edgetpu.zip to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\assets
2024-04-21 07:36:15: Downloading MobileNet Tiny...Checking 'C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral\objectdetection-mobilenet-tiny-edgetpu.zip'
2024-04-21 07:36:15: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\modules\ObjectDetectionCoral
2024-04-21 07:36:15: Extracting objectdetection-mobilenet-tiny-edgetpu.zip
2024-04-21 07:36:15: done.
2024-04-21 07:36:15: Copying contents of objectdetection-mobilenet-tiny-edgetpu.zip to assets...done
2024-04-21 07:36:15: Used modulesettings.json to get value EfficientDet Large
2024-04-21 07:36:16: Used modulesettings.json to get value false
2024-04-21 07:36:16: Used modulesettings.json to get value EfficientDet Medium
2024-04-21 07:36:16: Used modulesettings.json to get value false
2024-04-21 07:36:17: Used modulesettings.json to get value EfficientDet Small
2024-04-21 07:36:17: Used modulesettings.json to get value false
2024-04-21 07:36:17: Used modulesettings.json to get value EfficientDet Tiny
2024-04-21 07:36:17: Used modulesettings.json to get value false
2024-04-21 07:36:18: Used modulesettings.json to get value YOLOv5 Large
2024-04-21 07:36:18: Used modulesettings.json to get value false
2024-04-21 07:36:18: Used modulesettings.json to get value YOLOv5 Medium
2024-04-21 07:36:18: Used modulesettings.json to get value false
2024-04-21 07:36:19: Used modulesettings.json to get value YOLOv5 Small
2024-04-21 07:36:19: Used modulesettings.json to get value false
2024-04-21 07:36:19: Used modulesettings.json to get value YOLOv5 Tiny
2024-04-21 07:36:20: Used modulesettings.json to get value false
2024-04-21 07:36:20: Used modulesettings.json to get value YOLOv8 Large
2024-04-21 07:36:20: Used modulesettings.json to get value false
2024-04-21 07:36:20: Used modulesettings.json to get value YOLOv8 Medium
2024-04-21 07:36:21: Used modulesettings.json to get value false
2024-04-21 07:36:21: Used modulesettings.json to get value YOLOv8 Small
2024-04-21 07:36:21: Used modulesettings.json to get value false
2024-04-21 07:36:22: Used modulesettings.json to get value YOLOv8 Tiny
2024-04-21 07:36:22: Used modulesettings.json to get value false
2024-04-21 07:36:22: SELF TEST START ======================================================
2024-04-21 07:36:29: Debug: MODULE_PATH:           C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
2024-04-21 07:36:29: Debug: MODELS_DIR:            C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\assets
2024-04-21 07:36:29: Debug: CPAI_CORAL_MODEL_NAME: mobilenet ssd
2024-04-21 07:36:29: Debug: MODEL_SIZE:            small
2024-04-21 07:36:29: Debug: CPU_MODEL_NAME:        tf2_ssd_mobilenet_v2_coco17_ptq.tflite
2024-04-21 07:36:29: Debug: TPU_MODEL_NAME:        tf2_ssd_mobilenet_v2_coco17_ptq_edgetpu.tflite
2024-04-21 07:36:29: Info: TPU detected
2024-04-21 07:36:29: Info: Attempting multi-TPU initialisation
2024-04-21 07:36:29: Info: Supporting multiple Edge TPUs
2024-04-21 07:36:29: Info: Self-test for ObjectDetectionCoral. Success: True
2024-04-21 07:36:29: Self-test passed
2024-04-21 07:36:29: SELF TEST END   ======================================================
2024-04-21 07:36:30: Module setup time 00:01:09.59
2024-04-21 07:36:30: Setup complete                                                        
2024-04-21 07:36:30: Total setup time 00:01:11.33
Installer exited with code 0

Re: Coral module ver 2.2.2 in CPAI ver 2.6.2 errors

mailseth226-Apr-24 10:27

mailseth2

26-Apr-24 10:27

So, I see a few things going on here. First is that it doesn't look like the multi-TPU code is throwing the error. It looks like it's falling back to the single TPU original code that has been unchanged, and that's what's throwing the exception. So part of the problem here is that this fallback code isn't working right.

The other part is that it is falling back in the first place and I don't know why. Do you see any log messages that might show why? Looking at the logs you've posted, I can only notice possible problems in the older modules you've used, but most recently this self-test looks like it's passing. So I don't know why it'd be falling back to the single-TPU code.

I'm going to try to make a few changes to 'fix' the problem, but I suspect the actual problem is still hiding in there. As far as how you can 'fix' the problem for yourself right now: I'm not as familiar with how CPAI does its business, I'm more familiar with the lower level TPU-running code. So the first thing I'd try is explicitly selecting the single-TPU code if you're attempting to currently run the multi-TPU code. I think this PR will improve the situation in the next release:
Some changes that should fix & debug a multi/single TPU failure by seth-planet · Pull Request #1 · codeproject/CodeProject.AI-ObjectDetectionCoral · GitHub[^]

Re: Coral module ver 2.2.2 in CPAI ver 2.6.2 errors

Steve Winn28-Apr-24 11:43

Steve Winn

28-Apr-24 11:43

I tried uninstalling and reinstalling CPAI ver 2.6.2 along with deleting Program Files and Program Data folders. I wound up with the Coral ver 2.2.2 module again. While testing with the Explorer, I found the Coral module just stopping for some unknown reason. I am now back to YOLOv5 6.2 with ipcam-combined and ipcam-dark. Working well now. It would be nice to be able to get back to Coral ver 2.2.0 in my opinion.

Re: Coral module ver 2.2.2 in CPAI ver 2.6.2 errors

Steve Winn28-Apr-24 11:47

Steve Winn

28-Apr-24 11:47

I might try to roll CPAI back to 2.5.6 which is the last version that I think I have. I might also try nukeing the CPAI data in the registry as well.

Coral silently switches to using CPU

seashellz5925-Apr-24 12:34

seashellz59

25-Apr-24 12:34

On the latest CPAI and using a Coral USB, CPAI at some point switches to using the computer's CPU instead of the Coral. Blue Iris continues to work, but obviously my computer's CPU usage goes up and the response times are greatly increased.

After a few days of running CPAI with the Coral, I noticed that I hadn't had to restart the CPAI docker in quite a while (usually, the Coral either stops responding silently or shuts down explicitly a couple of times every single day). I was suspicious at this "success" and checked, and saw that CPAI was running the detections on my computer's CPU. The status still said "CPU (TF-Lite)" which it says even when the Coral is working, but the detections were taking ~88ms instead of the usual ~13ms.

As with every other problem with the Coral, this was temporarily remedied by me manually restarting the CPAI docker.

Re: Coral silently switches to using CPU

Chris Maunder26-Apr-24 4:06

Chris Maunder

26-Apr-24 4:06

USB Coral? Windows host?

cheers
Chris Maunder

Re: Coral silently switches to using CPU

seashellz5926-Apr-24 9:06

seashellz59

26-Apr-24 9:06

Yes

Flooded with detect_adapter.py: WARNING ⚠️ NMS time limit 0.550s exceeded

Member 1571860325-Apr-24 10:47

Member 15718603

25-Apr-24 10:47

Just updated to 2.6.2 docker

After some time log get flooded with:

13:26:18:detect_adapter.py: WARNING ⚠️ NMS time limit 0.550s exceeded
13:26:28:detect_adapter.py: WARNING ⚠️ NMS time limit 0.550s exceeded
13:27:25:detect_adapter.py: WARNING ⚠️ NMS time limit 0.550s exceeded
13:27:30:detect_adapter.py: WARNING ⚠️ NMS time limit 0.550s exceeded

It didnt do that ever before.
How do I fix this?

Re: Flooded with detect_adapter.py: WARNING ⚠️ NMS time limit 0.550s exceeded

mailseth225-Apr-24 11:30

mailseth2

25-Apr-24 11:30

What module and hardware?

Re: Flooded with detect_adapter.py: WARNING ⚠️ NMS time limit 0.550s exceeded

Sean Ewington25-Apr-24 12:12

Sean Ewington

25-Apr-24 12:12

Thanks very much for your report. Could you please share your System Info tab from your CodeProject.AI Server dashboard?

Thanks,
Sean Ewington
CodeProject

Re: Flooded with detect_adapter.py: WARNING ⚠️ NMS time limit 0.550s exceeded

Chris Maunder26-Apr-24 3:37

Chris Maunder

26-Apr-24 3:37

You're using Coral, right? USB or PCIe?

This error occurs when you're using the YOLOv5 models in Coral, and the non-max suppression method takes too long to sort through all the bounding boxes identified in an image.

What hardware are you running the docker container on, and if possible, could you post an example of an image that's causing this?

cheers
Chris Maunder

Re: Flooded with detect_adapter.py: WARNING ⚠️ NMS time limit 0.550s exceeded

Member 1571860326-Apr-24 7:12

Member 15718603

26-Apr-24 7:12

Sorry, forgot to post system info but then could edit post until approved.

not using coral, afaik.

using cuda12.2.2.6.2, upgraded from 12_2.2.5.6 the day before
with Blue Iris 5.9.0.1

CodeProject.AI
Docs
Forums
The Code
CodeProject.AI Explorer
cpai
Offline
2.6.2
☀️
Your self-contained AI server.    Need help? Common solutions or ask a Question.    Use in your apps: API guide or add your own AI module.   FAQs: Blue Iris, Home Assistant, Agent DVR, Wyze cams.

Server version:   2.6.2
System:           Docker (cpai)
Operating System: Linux (Ubuntu 22.04)
CPUs:             Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz (Intel)
                  1 CPU x 8 cores. 8 logical processors (x64)
GPU (Primary):     (NVIDIA), CUDA:  (up to: ), Compute: , cuDNN: 8.9.6
System RAM:       16 GiB
Platform:         Linux
BuildConfig:      Release
Execution Env:    Docker
Runtime Env:      Production
Runtimes installed:
  .NET runtime:     7.0.17
  .NET SDK:         Not found
  Default Python:   3.10.12
  Go:               Not found
  NodeJS:           Not found
  Rust:             Not found
Video adapter info:
System GPU info:
  GPU 3D Usage       0%
  GPU RAM Usage      0
Global Environment variables:
  CPAI_APPROOTPATH = <root>
  CPAI_PORT        = 32168

I had something weird happen with FaceProcessing

rdcrumbaker25-Apr-24 3:50

rdcrumbaker

25-Apr-24 3:50

Been running 2.6.2 since it's release with YOLOv8 v1.4.3 and FaceProcessing v1.10.2 as well.

Then I restarted the server that runs the Docker environment. Upon restart it keep telling me:

An item with the same key has already been added. Key: FaceProcessing.

I searched all the AppModules for extra FaceProcessing but nothing...
The only thing that would allow me to start CodeProject was to rename the folder FaceProcessing under

C:\ProgramData\CodeProject\AI\docker\modules

Which I bond with the way I run the docker:

docker run --name cuda12_2-2.6.2 -d -p 32168:32168 --gpus all  --mount type=bind,source=C:\ProgramData\CodeProject\AI\docker\data,target=/etc/codeproject/ai --mount type=bind,source=C:\ProgramData\CodeProject\AI\docker\modules,target=/app/modules codeproject/ai-server:cuda12_2-2.6.2

This was a clean install, meaning nothing was in the ProgramData\CodeProject\AI\Docker folder until I installed YOLOv8 and Upgraded FaceProcessing. Those were put there on the install.

Re: I had something weird happen with FaceProcessing

Chris Maunder26-Apr-24 3:20

Chris Maunder

26-Apr-24 3:20

This is an issue where you have a module pre-installed then you update or reinstall and it appears in a different folder. This has been fixed in our next release due next week

cheers
Chris Maunder

Blueiris + CodeProject, how do I detect all things? not just "person,car,truck" -- Resolved

DingbatCA24-Apr-24 11:40

DingbatCA

24-Apr-24 11:40

Understanding that the YoloV5 model likes to detect house plants and tooth brushes in my backyard, how do I detect all things? Currently in BlueIris under Camera Settings -> Alert -> AI configuration I have "To confirm" set to the default of "person,car,truck,bus,bicycle,vehicle". But I know there is a lot of other stuff, like dog cat... Toothbrush. Can I set "To confirm" to a wild card?

modified 4 days ago.

Re: Blueiris + CodeProject, how do I detect all things? not just "person,car,truck"

Mike Lud24-Apr-24 14:10

Mike Lud

24-Apr-24 14:10

You can just leave it blank and it will detect all the objects that the model detects

How do I force all models to use my Coral USB?

Member 1624977923-Apr-24 7:42

Member 16249779

23-Apr-24 7:42

i recently installed codeproject-ai and pass my coral usb stick through to the docker container. i've downloaded the coral usb module within the cpai interface, but i'm not sure how to make sure all other installed models are running through my coral stick and not cpu.

is there a way to verify this?

Coral warning: "WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs"

DeadpoolW23-Apr-24 4:40

DeadpoolW

23-Apr-24 4:40

Running Codeproject AI 2.6.2 with object detection (Coral) 2.2.2. And when I watch in the log I get a lot of the following warnings:

16:27:48:objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
16:27:53:objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
16:27:58:objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
16:28:03:objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
16:28:08:objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
16:28:13:objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
16:28:18:objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.

What causes this? and how can I fix this?

Re: Coral warning: "WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs"

mailseth223-Apr-24 5:56

mailseth2

23-Apr-24 5:56

It should be booting itself back up as soon as new work arrives, so it shouldn’t be a problem.

Re: Coral warning: "WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs"

jeremeyi23-Apr-24 18:30

jeremeyi

23-Apr-24 18:30

But detection time seems to be a bit slower now, 15-20ms before vs 25ms now? That is really not that much slower but the constant red in the status window makes it seem like something bad is happening.

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.