Skip to main content
amrutah0001
Inspiring
Apr 7, 2021 12:02 PM UTC
Question

Image recognition

I am performing image recognition which is provided by RPA learning path, but in that it is not showing me result of image addition i.e 13.

For reference[View:/cfs-file/__key/communityserver-discussions-components-files/61/21.1-RPA-Tutorial-_5F00_-ImageRecognition-Low-Code_2D00_-105_2D00_2.pdf:320:240]

    9 replies

    danny.verb
    danny.verb
    Employee
    Apr 7, 2021 5:58 PM UTC

    To help, you'll need to provide some more details. What step are you stuck on and what are you expecting?

    amrutah0001Author
    Inspiring
    Apr 8, 2021 4:11 AM UTC

    It is regarding image recognition I store image of 8,+,5,= so as per pdf it should be excused in calculator and answer would be 13 but it is not executing and that why I am not able to complete this lesson

    gavinh
    gavinh
    Known Participant
    Aug 11, 2021 9:38 AM UTC

    I'm having a similar issue, I've really been struggling to get the RPA process to recognise the buttons based on the support images. I've tried changing the pixel precision and sometimes it recognises 8 and 5 but then uses the divide button instead of the add button. I've tried zooming in when creating the support images as well as including a reasonable border around them but nothing seems to work consistently

    saikiranb654094
    Participating Frequently
    Nov 22, 2023 4:22 PM UTC

    You have to take the screenshot clearly then only bot will reconize the image correctly

    gopalt0943
    Known Participant
    Nov 23, 2023 10:23 AM UTC

    Hi [mention:573ecd0fba2b43a1995d6b9f2c4698ef:e9ed411860ed4f2ba0265705b8793d05] 

    1. Variable Setup:

      • Create a variable named "calculator result."

    2. Open Calculator Application:

      • In the "Open Application" activity:
        • Set the executable name to "calc.exe."
        • Use "Find by Window Title" and set the expected window title to "Calculator."

    3. Create a Support Image:

      • Manually open the calculator in the Appian RPA agent.
      • From the Appian RPA agent menu in the taskbar, select "Create Support Image."

    4. Support Image Marking:

      • Mark the new image for the number 8, save the image, rename it, and click "Save Image."
      • Repeat this process for the "+" icon, saving images accordingly.
      • Similarly, save images for values you know, like 5 and "=".

    5. Configure Windows:

      • For the "Eight" configuration window:

        • Select "Full Screen" in the search section.
        • Set the max wait time to 2 seconds.
        • Choose "Exact Match" for pixel and color tolerance.
        • Enable mouse actions.
        • For the location image, select "Throw Exception if Not Found."
        • After completion, set "Wait Before Executing Next Actions" to 4 seconds.

      • For the "Plus" configuration window:

        • Set "Don't Wait" for wait time.
        • Choose "Exact Match" for pixel and color tolerance.
        • Enable mouse actions.
        • For the location image, select "Throw Exception if Not Found."

      • Repeat the same configuration process for the "Five" value.

    6. Keyboard Shortcuts:

      • Use the "Press Keyboard Shortcuts" activity.
        • Change the display name to "Copy the Result."
        • In modifier keys, select "Ctrl."
        • In additional keys, select "Characters" and provide "c."
        • In interaction, select "Press and Release Keys."

    7. Get Clipboard Value:

      • Use the "Get Clipboard Value" activity.
        • In the configuration output section:
          • Select "Is Stored As" in the dropdown.
          • In the target, provide the variable created, i.e., "calculator result."
          • After completion, select the "Take a screenshot" option.

    Follow these steps carefully, and you should obtain the correct result.
    Follow these screenshots for a better understanding.

    Terms & ConditionsAccessibility statement