We implemented the sketch feature extraction mechanism mentioned in the following paper: http://rationale.csail.mit.edu/publications/Ouyang2009IJCAI.pdf
- Download the files
- Run
python setup.py buildto build the code - Run
python setup.py installto install the module (this action may require sudo privileges) - You can try running the following code to see if it is working:
from sketchfe import FeatureExtractor
idm = FeatureExtractor.IDMFeatureExtractor()
idm.extractimage_test()
A sketch is defined as a set of strokes including ink points. Sketched symbols can be in 3 different formats that are described below.
The following examples refer to the same sketch.
{"id":"asdasd",
"strokes":
[{"id":"1","points":[{"pid":"qwe","time":4.6,"x":1,"y":9},{"pid":"aty","time":8,"x":6,"y":5}]},
{"id":"21","points":[{"pid":"uio","time":9,"x":10.2,"y":44.4},{"pid":"asd","time":12,"x":3,"y":77},{"pid":"cvb","time":13,"x":5,"y":7}]
}]
}
<sketch id="1">
<point id="1" time="4.6" x="1" y="9" />
<point id="2" time="8" x="6" y="5" />
<point id="3" time="9" x="10.2" y="44.4" />
<point id="4" time="12" x="3" y="77" />
<point id="5" time="13" x="5" y="7" />
<stroke id="1">
<arg type="point">1</arg>
<arg type="point">2</arg>
</stroke>
<stroke id="2">
<arg type="point">3</arg>
<arg type="point">4</arg>
<arg type="point">5</arg>
</stroke>
</sketch>
1\t9\t0\t4.6\n6\t5\t0\t8\n10.2\t44.4\t1\t9\n3\t77\t1\t12\n5\t7\t1\t13
The next version will include more feature extraction methods.
This library has built-in functions to load sketches from XML, JSON and points-as-table files (see the previous section for the content organization of these types). Sample usage of these functions are given below.
from sketchfe import shapecreator
filename = "sketch.xml" #the name of the sketch file
with open(filename,'rb') as f:
filecontent = f.read()
loadedSketch = shapecreator.buildSketch('xml',filecontent)
from sketchfe import shapecreator
filename = "sketch.json" #the name of the sketch file
with open(filename,'rb') as f:
filecontent = f.read()
loadedSketch = shapecreator.buildSketch('json',filecontent)
from sketchfe import shapecreator
filename = "sketch.txt" #the name of the sketch file
with open(filename,'rb') as f:
filecontent = f.read()
loadedSketch = shapecreator.buildSketch('school',filecontent)
By creating an instance of IDMFeatureExtractor , which is a sub-class of FeatureExtractor, you can extract features of a sketched symbol that is represented as an instance of Sketch class. The following code snippet basically extracts feature of a Sketch instance sk:
import sketchfe.FeatureExtractor.IDMFeatureExtractor
featextractor = IDMFeatureExtractor()
features = featextractor.extract(sk) # features includes the feat. representation as an array
- oaltiok15@ku.edu.tr - Ozan Can Altıok
- kkaiyrbekov15@ku.edu.tr - Kurmanbek Kaiyrbekov
Please don't hesitate to open issues on the repository in case you think there is a bug.