Microsoft Custom Vision

The Microsoft Custom Vision Service is a Classification service that allows users to customize and embed state-of-the-art computer vision image analysis for specific domains with Azure Cognitive Services.

The Microsoft Custom Vision Service allows users to create Custom Tags from documents or images, based on their own custom needs for image recognition. Users start by uploading samples of each Custom Tag and sending them to Azure Cognitive Services to train the Classification model**.**

Possible use cases

  • Distinguish between different types of documents.
  • Distinguish between different types of variations of documents.
  • Distinguish between different types of invoices.

Service Setup

  1. Open the Project Detail View of the project you would like to add the service to.
  2. Click on the Add Service button in the command bar.

  3. Select Microsoft Custom Vision Service from the available Service Types.

  4. A new Service Configuration Wizard will open:
    (When navigating the Wizard, please make sure to use the Next Step button in the command bar to save any changes made).

  • Step 1 - Allows configuration of various service settings, including the name and description. The default settings are sufficient for most use cases.
  • Step 2 - Allows adding User Defined Categories to train the service on.
  • Step 3 - Training
    1. Click Upload Training Documents in the command bar
    2. Select the User Defined Category you want to upload documents to.
      Demo training files are available here.
    3. Upload files for each User Defined Category you wish to train the service on.

    4. Once you have uploaded all your documents, click the Train Service button in the command bar to train your service. (Note that training can take several minutes!)

    5. Click Process on the dialog window that appears. Leave all settings as default.
    6. A progress dialog will appear displaying the progress of the training.
      Training times can vary depending on the number of files that have been uploaded for training.
    7. The progress dialog should automatically close once the training has been completed.
  • Step 4 - Verification. No verification required.
  • Click on the Complete button in the command bar to validate your service configuration and close the wizard.

Service Configuration Settings

The Microsoft OCR Service can be configured by the user as a flexible solution. The following Settings are available:

Setting Type Required Type Description
ArchivingStrategy Optional Days before documents get deleted.
BatchSize Hidden Processing batch size.
DocumentProcessedStatus Optional Document status used to denote that a document has been processed.
Enabled Hidden Enable or disable the service.
ExecuteBeforeProcess   When set up as a child service, specify whether this service should be executed before the parent service gets executed.
ExecuteAfterProcess   When set up as a child service, specify whether this service should be executed after the parent service gets executed.
Password Optional Used for service authentication. Custom Code can be used to set the password. Can be set per document.
RemoveComments Optional Remove human comments from a document.

Add and Process Documents

  1. In the Microsoft Custom Vision Service click on Inbox button.
  2. Select the Status you want to upload and use Status None or Received for new documents that have not been processed yet.
  3. Select an optional category if you know the category for the document, if you don’t want to select one just click on “No selection”.
  4. Find the files on your Local machine and upload them. The demo’s test files can be found at the following link: Click here.
  5. After all the documents have been uploaded you can check the documents to be processed, click on Processed Checked to process the documents.

It is recommended to only process a few documents at a time, especially if it is a new service to properly test if you receive the results you want before processing everything.

View Processed Documents

  1. In the Microsoft Custom Vision Service click on the Outbox button.
  2. You can view your Processing results by opening a processed doc for verification.