An implementation of an indexed skip list data structure in python.

Skip lists are a data structure that can be used in place of balanced trees. Skip lists use probabilistic balancing rather than strictly enforced balancing and as a result the algorithms for insertion and deletion in skip lists are much simpler and significantly faster than equivalent algorithms for balanced trees.

Skip lists are balanced by consulting a random number generator. Although skip lists have bad worst-case performance, no input sequence consistently produces the worst-case performance (much like quicksort when the pivot element is chosen randomly).

Each element is represented by a node, the level of which is chosen randoml when the node is inserted without regard for the number of elements in the data structure. A level i node has i forward pointers, indexed 1 through i. There is no need to store the level of a node in the node. Levels are capped at some appropriate constant MaxLevel. The level of a list is the maximum level currently in the list (or 1 if the list if empty). The header of a list has forward pointers at levels one through MaxLevel. The forward pointers of the header at levels higher than the current maximum level of the list point to NIL.

Skip list operations are analogous to that of a binary tree. They include: search, insert, and delete. Note that skip lists are easily extendable to support operations like "find the minimum key" or "find the next key".

An element NIL is allocated and given a key greater than any legal key. All levels of all skip lists are terminated with NIL. A new list has level 1 and all forward pointers of the list's header point to NIL.

Search works by traversing forward pointers that do not overshoot the node containing the element being searched for. When no more progress can be made at the current level of forward pointers, the search moves down to the next level. When we can make no more progress at level 1, we must be in front of the node that contains the desired element (if it is in the list).

At what level should the search be started? William's analysis suggests that ideally we should start at level L where we expect log_{1/p}n where n is the number of elements in the list and p is the fraction of nodes in level i that also have level i+1 pointers. Starting a search at the maximum level in the list does not add more than a small constant to the expected search time.

To insert or delete a node, we simply search and splice. A vector update is maintained so that when the search is complete, update[i] contains a pointer to the rightmost node of level i. The new node is of a random level. If the insertion generates a node with a greater level than the previous maximum, both Maxlevel and the appropriate portions of the update vector are updated. After each deletion, we check if we have deleted the maximum element of the list and if so, decrease the maximum level of the list.

References Skip list wikipedea article, A Skip List Cookbook by William Pugh

https://github.com/ryszard/goskiplist

http://tech.puredanger.com/2007/10/03/skip-lists/

http://stackoverflow.com/questions/256511/skip-list-vs-binary-tree http://www.cl.cam.ac.uk/techreports/UCAM-CL-TR-579.pdf http://habrahabr.ru/post/250815/ http://www.cs.tau.ac.il/~shanir/nir-pubs-web/Papers/OPODIS2006-BA.pdf http://stackoverflow.com/questions/2623086/is-a-variable-swap-guaranteed-to-be-atomic-in-python https://blog.filippo.io/building-python-modules-with-go-1-5/#thecompletedemosource http://stackoverflow.com/questions/3489560/purely-functional-concurrent-skip-list http://eternallyconfuzzled.com/tuts/datastructures/jsw_tut_skip.aspx http://www.cs.umd.edu/~meesh/420/Notes/MountNotes/lecture11-skiplist.pdf

https://github.com/amirouche/AjguDB http://blog.gocept.com/2013/07/15/reliable-file-updates-with-python/ https://github.com/WoLpH/portalocker