Library

Course: Show And Tell: Sikuli - Pattern-Matching and Automation

Show And Tell: Sikuli - Pattern-Matching and Automation

  • Life Time Access
  • Certificate on Completion
  • Access on Android and iOS App
About this Course

SikuliX is very unusual - a scripting/automation technology that relies on pattern matching, and is available for use via Python or Java. Developed at the User Interface Design Group at MIT, is a powerful and easy-to-use technology that uses image recognition to automate just about anything that appears on-screen.

Sikuli is rather hard to slot - it offers all of the functionality of an automation or scripting tool, but it also offers some powerful and very novel image-matching functionality for truly novel use-cases that revolve around image search. In addition it has an OCR-mode, in which image matches are performed after converting those image patterns to text. This gives rise to some pretty new applications.

The OCR-functionality is powered by Tesseract, an open-source optical character recognition engine whose development is sponsored by Google.

Using discussion forums

Please use the discussion forums on this course to engage with other students and to help each other out. Unfortunately, much as we would like to, it is not possible for us at Loonycorn to respond to individual questions from students:-(

We're super small and self-funded with only 2 people developing technical video content. Our mission is to make high-quality courses available at super low prices.

The only way to keep our prices this low is to *NOT offer additional technical support over email or in-person*. The truth is, direct support is hugely expensive and just does not scale.

We understand that this is not ideal and that a lot of students might benefit from this additional support. Hiring resources for additional support would make our offering much more expensive, thus defeating our original purpose.

It is a hard trade-off.

Thank you for your patience and understanding!

Who is the target audience?

  • Yep! Automation testers and folks look to automate repetitive tasks
  • Yep! Data professionals looking to extract hard-to-pull data
  • Yep! Business professionals looking to dynamically update models they've built
Basic knowledge
  • Absolutely basic Python or Java programming ability
What you will learn
  • Automate data-pulls from sites and sources that block other scripting tools
  •  Generate alerts based on Facebook/Skype and other hard-to-detect events
  •  Search large PDFs for images that "look like" the one you are searching for
Curriculum
Lectures quantity: 32
Common duration: 03:02:17
Introduction
  • You, This Course, and Us  

    You, This Course, and Us

  • Something Completely Fresh  

    Something Completely Fresh

  • Installation  

    Installation

Getting Stuff Done
  • Hello world  


    Hello world

  • Under the hood  

    Under the hood

  • Opening up a calculator - the naive way  

    Opening up a calculator - the naive way

  • Opening up a calculator - a smarter way  

    Opening up a calculator - a smarter way

  • Regions and Patterns  

    Regions and Patterns

  • Matching  

    Matching

  • Working with Applications  

    Working with Applications

  • Typing into Applications  

    Typing into Applications

  • System and Environment Variables  

    System and Environment Variables

Language Constructs
  • User Interactions  

    User Interactions

  • Conditionals - If, else and elif  

    Conditionals - If, else and elif

  • Dynamic calculations using the calculator  

    Dynamic calculations using the calculator

More Language Constructs
  • For-loops  


    For-loops

  • Hotkeys  

    Hotkeys

Sikuli and Java
  • Sikuli and Java  


    Sikuli and Java

  • Sikuli and Selenium  

    Sikuli and Selenium

Unusual Use-cases and Smart Sikuli
  • Working with Microsoft Word  

    Working with Microsoft Word

  • Drag-and-Drop  


    Drag-and-Drop

  • System Power Settings via Checkboxes  

    System Power Settings via Checkboxes

  • Deleting loads of emails in one go  

    Deleting loads of emails in one go

  • Locating icons in a crowded folder  

    Locating icons in a crowded folder

  • Emptying the Recycle Bin  

    Emptying the Recycle Bin

  • Facebook automation  

    Facebook automation

  • Skype automation  

    Skype automation

  • Image searches inside large PDFs  

    Image searches inside large PDFs

  • OCR introduced  


    OCR introduced


  • OCR with Excel  

    OCR with Excel

  • Mass data downloads  

    Mass data downloads

  • Automating a simple game  

    Automating a simple game

Reviews (0)