Skip to main content
K
kavitar298810
May 22, 2023
Question

Image Recognition RPA

  • May 22, 2023
  • 9 replies
  • 0 views

It is regarding image recognition I store image of 8,+,5,= so as per pdf it should be excused in calculator and answer would be 13 but it is not executing and that why I am not able to complete this lesson

Facing the issue after completing the all steps provided by Appian Document

Anyone Guide me how can we resolve this....

9 replies

randy.richeson
randy.richeson
May 23, 2023

You might need to add a new image. Try selecting the eye icon in the Support files to verify the image is an '8'. If it is not, then replace this image with another. Also, if the image looks like an '8', you might try adjusting the Pixel tolerance or Color tolerance - for example to 'Very low' and test again. This is an example of the image that worked for me using the win32calc.exe calculator. 

K
kavitar298810Author
May 24, 2023

[emoticon:ca08b2c27c2f40e993e89508acf29e0b]

Facing the same issue

I configured values below image

and added images as like you said

But not working

guide me @randy.richeson how can i resolve this issue...

randy.richeson
randy.richeson
May 25, 2023

Try increasing the Pixel and Color tolerance to higher values like Low or Medium. I have found that sometimes this works. If it does not, try creating a new robotic task and use the agent 'Create Support Image' option to create new images for it. Make sure you are capturing the images on the same host machine the robot will run on. I reproduced this same error with an older robotic task, but after creating a new robotic task with new images it completed successfully with an exact match for Pixel and Color tolerance. 

G
gopalt0943
November 28, 2023

Hi [mention:6dee2411d5c14b25be260223e3880be7:e9ed411860ed4f2ba0265705b8793d05] 

Setting Up Variables:

  1. Create a variable called "calculatorResult."

Opening the Calculator Application:

  1. In the "Open Application" activity:
    • Set the executable name to "calc.exe."
    • Use "Find by Window Title" and set the expected window title to "Calculator."

Creating Support Images:

  1. Manually open the calculator in the Appian RPA agent.
  2. From the Appian RPA agent menu in the taskbar, select "Create Support Image."

Support Image Marking:

  1. Mark the new image for the number 8, save it, rename it, and click "Save Image."
  2. Repeat for the "+" icon, saving images accordingly.
  3. Similarly, save images for known values like 5 and "="

Configuring Windows:

  1. For the "Eight" configuration window:

    • Select "Full Screen" in the search section.
    • Set the max wait time to 2 seconds.
    • Choose "Exact Match" for pixel and color tolerance.
    • Enable mouse actions.
    • For the location image, select "Throw Exception if Not Found."
    • After completion, set "Wait Before Executing Next Actions" to 4 seconds.

  2. For the "Plus" configuration window:

    • Set "Don't Wait" for wait time.
    • Choose "Exact Match" for pixel and color tolerance.
    • Enable mouse actions.
    • For the location image, select "Throw Exception if Not Found."
    • Repeat the same for the "Five" value.

Keyboard Shortcuts:

  1. Use the "Press Keyboard Shortcuts" activity.
    • Change the display name to "Copy the Result."
    • In modifier keys, select "Ctrl."
    • In additional keys, select "Characters" and provide "c."
    • In interaction, select "Press and Release Keys."

Getting Clipboard Value:

  1. Use the "Get Clipboard Value" activity.
    • In the configuration output section:
      • Select "Is Stored As" in the dropdown.
      • In the target, provide the variable created, i.e., "calculatorResult."
    • After completion, select the "Take a screenshot" option.

Follow these steps carefully, and you should get the correct result. Refer to the accompanying screenshots for a better understanding.

navyam0964
navyam0964
January 3, 2025

Hi 

I've followed the same steps mentioned above ,changed the color and pixel to high.Robotic task completed succesfully but the result is not being stored in the target variable.

miguelangel.carnero
miguelangel.carnero
January 9, 2025

Maybe dumb question, but to be sure, Are you getting the expected result but it is not stored in the variable? Have you double checked that the Variable Type is the correct one to store the data type it will receive?

Terms & ConditionsAccessibility statement