possibility of detecting and clicking an image on screen?

[pitchninja]

Hi there, I'm not overly familiar with mini Mouse, it works great so far with what I've used it for. I was just wondering though if anyone might know if the below scenario is possible somehow with Mini Mouse:

I use an application that has images slowly move up the screen in a particular area. Eventually the images sit still. Is it by any chance possible to have Mini Mouse somehow maybe do a sweep or something across a given area and if it sees part of that image, it will click that image wherever it currently sits to select it and then click somewhere else? If it is possible, is it an extremely involved process?

If it CAN do the above, can it do that same type of sweep/detection for that same type of image and then if it sees it, it will click it - again wherever it currently sits - and then click another location different from the first?

[Steve]

Hi pitchninja

For this I would use the detect image action (www.turnssoft.com/conditions.html#detectimage) within an IF THEN ELSE condition (www.turnssoft.com/conditions.html#thenelse). When I find the image i would click it with mouse click (www.turnssoft.com/conditions.html#mouseclick). To loop over the screen and continually monitor the screen coordinates i am looking for I'd use a goto macro line referencing remarks for START and FINISH (www.turnssoft.com/conditions.html#gotomacroline).

* | START
1 | IF | DETECT IMAGE | image path D:\Dropbox\Macro\File\pics\capture\STEVE.BMP::at 50 107 232 475::match quick::move mouse yes | IMAGE FOUND | THEN
  2 | RUN ACTION | MOUSE CLICK | Left click at %MOUSE_X% %MOUSE_Y% 1 times with 0 ms delay
  3 | RUN ACTION | GOTO MACRO LINE | FINISH
4 | IF | ELSE
  5 | RUN ACTION | GOTO MACRO LINE | START
6 | IF | END IF
* | FINISH

Notice in the example that i've disabled the internal MMM event logger. The logger will fill on a loop like this so it's best to disable it prior to running the macro.

[pitchninja]

Oh wow thanks for the response Steve. Lots of info there to look up and learn about for sure. Take me a bit as a noob I'm sure, but at least I've got a good reference point to go by.
EDIT:
One question I do have though, I did mention that I would want it to click that image and then click somewhere else on the screen. It would basically do it 5 times with the end result being 5 of that same image aligned in a column. Would that be a matter of having 5 separate loop sections maybe to do this? So the first loop clicks the image and then a specific part of the screen, the second loop finds another of that same image but clicks right below where the first image was placed, and so on?

[pitchninja]

Okay so I finally had some time to sit down with this. It's not working at all. When I do the step you did where you right-click and then save the image, I name it but then it looks like what I attached. I'm following your steps exactly in order and I see according to your video that it saved your image and it displayed correctly but when I do what you did, that is what I get. I'm not sure how to proceed from here. Can you help?

Attachments:

[Steve]

Jun 17, 2022 22:08:17 GMT pitchninja said:

Okay so I finally had some time to sit down with this. It's not working at all. When I do the step you did where you right-click and then save the image, I name it but then it looks like what I attached. I'm following your steps exactly in order and I see according to your video that it saved your image and it displayed correctly but when I do what you did, that is what I get. I'm not sure how to proceed from here. Can you help?

Are you scaling up your screen resolution?  MMM is getting the native screen X and Y coords.  I need to add a mechanism into the code to auto-adjust for the scaling.  If your scaling up above 100% your screen coords might need to be adjusted with the current version.

[Shory9zeci]

Hello

I'm unable to move mouse to picture, i follow the steps in video.
Ive try exactly the same steps you made and doesn't work

Thank you

[kingoned]

Jun 23, 2022 12:54:15 GMT Shory9zeci said:

Hello

I'm unable to move mouse to picture, i follow the steps in video.
Ive try exactly the same steps you made and doesn't work

Thank you

Same problem, why it's not working?

Thanks!



* | START

1 | IF | DETECT IMAGE | image path C:\Users\david\Desktop\test.bmp::at 65 279 188 666::match quick::move mouse yes | IMAGE FOUND | THEN

2 | RUN ACTION | MOUSE CLICK | Left click at %MOUSE_X% %MOUSE_Y% 2 times with 100 ms delay and lock the mouse

3 | RUN ACTION | GOTO MACRO LINE | FINISH

4 | IF | ELSE

5 | RUN ACTION | GOTO MACRO LINE | START

6 | IF | END IF

* | FINISH