Articles → UiPath → Computer vision recorder in UiPath

Computer vision recorder in UiPath

In this article, we will discuss the computer vision recorder in UiPath.

Purpose

Computer Vision neural network is the set of activities developed by UiPath’s Machine Learning inhouse team. But what is this Jargon "Neural Network"?

In UiPath, the neural network identifies the UI element such as dropdown, textbox, checkbox etc.

How to enable CV recording in UiPath Studio?

To enable the CV recording, you have to add the API key from orchestrator to the project settings. To do that.

1. Go to the orchestrator i.e.http://cloud.uipath.com/

2. Go to "Admin" → "Licenses" → "Robots & Services".

Picture showing the Orchestrator to generate or copy the API key for computer vision

Click to Enlarge

3. You can either copy the existing API key or generate the new one.

4. Go to "Project Settings" → "Computer Vision" and copy the API key in "Run value" and "Debug value" fields.

Picture showing the Project Settings for copying the computer vision API key from Orchestrator

Click to Enlarge

5. Click on the "Ok" button.

How does a computer vision recorder work?

Computer vision recorder works in this way

      1. First, the screen on which the recording needs to be done is indicated.

      2. The screen is then sent to the CV server for processing.

      3. Once the processing is done, the wizard enters the recording mode.

Demo

For opening the computer vision recorder, go to "Recording" → "Computer Vision"

Picture showing the Computer Vision recorder in the Recording menu of the UiPath studio

Click to Enlarge

Computer vision recorder will appear.

Click to Enlarge

Click on the "Record" button and indicate the screen. A message will appear, which means the screen is sent to the CV server for the processing.

Picture showing the loading window when UI element is send to the server

Click to Enlarge

Once the image is processed, the recording mode is started. You can perform multiple activities like write text, click, extract table etc.

Click to Enlarge

You can stop the recording by clicking on the "Stop Recording" button. Post that, click on the "Save & Exit" button for saving the recording.

Once the recording is saved, you can see the recording in the designer pane.

Picture showing the list of activities in the designer pane once the recording is completed

Click to Enlarge

Posted By -	Karan Gupta

Posted On -	Friday, February 5, 2021

Query/Feedback

Your Email Id

Subject

Query/Feedback	Characters remaining 250