What's project Sikuli?

Developers has new language to look on , that is "SIKULI". With a basic understanding of Python, people can write programs that incorporate screen shots of graphical user interface (GUI) elements to automate computer work.THis language was devised at the MIT.Sikuli is a visual technology to search and automate graphical user interfaces (GUI) using images (screenshots).

The first release of Sikuli contains Sikuli Script, a visual scripting API for Jython, and Sikuli IDE, an integrated development environment for writing visual scripts with screenshots easily. Sikuli Script automates anything you see on the screen without internal API's support. You can programmatically control a web page, a desktop application running on Windows/Linux/Mac OS X, or even an iphone application running in an emulator.

The main purpose of sikuli is to use images and get the functionality done with them. Like in the below example, we have a screen with Search box and when we click the targeted image , "hello world" should be automatically entered into the searchbox. well just have a look at this now.

got a basic example from their site check it out
Let's begin the tutorial with a customary Hello World example!

You will learn how to capture a screenshot of a GUI element and write a Sikuli Script to:

Click on the element
Type a string into the element
The goal of the Hello World script is to automatically type "Hello World" into the spotlight search box, like this:


Now, open the Sikuli IDE. We begin by taking the screenshot of our target, the Spotlight symbol in the upper-right corner so that we can tell Sikuli Script what to look for and click on.

Sikuli Script provides two methods to switch to the screen capture mode. The first method is to click on the camera button in the toolbar.


The second method is to press the hot-key (Command + Shift + 2 Macs). This hot-key can be triggered even if the script editor is minimized.

In the screen capture mode, the screen will look darker and freeze momentarily. The entire desktop becomes like a canvas. We can draw a rectangle around the target, the spotlight symbol.



The image within the rectangle will be captured and inserted into the editor.


Next, we are going to use the click function to simulate a mouse click on the given target. Type click() and put the image inside of the pair of parenthesizes as the argument to the function.


The next action is to type "Hello World" in to the search box. This is very straightforward.


The type function will type the string given in the argument into whichever input control that has the focus. After clicking on the spotlight symbol, we can expect the spotlight search box will be the input that has the focus.

Congratulations! You have completed your first Sikuli Script. You can press the run button to see this script in action!