

UI Automation opens as a side panel on the desktop. This side panel is a recorder, where Watson learns every action (click / type) that is performed on the screen.

The recorded actions are saved as a skill. It can be edited and reviewed before adding to the catalog.





Watson identifies that the input might be in a spreadsheet. And it is able to read the spreadsheet.
As UI automation records the actions, it takes a screenshot along with annotation of the action area.


Watson performs the task and user validates.
Watson has recorded and validated th etask. It can now perform it independently.


Installation of UI automation - browser extension and desktop client.

UI automation shows recorded actions and asks for confirmation before saving as a skill.

User validation happens only for critical steps

Watson prompts the user incase a manual step is required

For validation, watson asks for inputs before hand.

UI automation performs the task independently. At the end, it also shows the time saved by the user.


.png)

.png)