Skip to content

hong-yh/datasheet-scrubber

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FASoC Datasheet-Scrubber

The FASoC Datasheet Scrubber is a utility that scrubs through large sets of PDF datasheets/documents in order to extract key circuit information. The information gathered is used to build a database of commercial off-the-shelf (COTS) IP that can be used to build larger SoC in the FASoC design. More information here.

Setup instructions

  1. Ensure your machine has the correct python version and all of the python modules required to run through the datasheet scrubber.

    • Requirements: Python 3.6 (packages pandas, scipy, matplot, matplotlib, pdfminer.six, pypdf2, request, lxml, tabula-py, sklearn, regex, keras, tensorflow, pdf2image, pillow, pytesseract, numpy, opencv-python, gensim, nltk). Python versions below 3.6 are not supported.
  2. Ensure you have ssh keys setup for github. Instructions for generating and adding ssh keys can be found here.

  3. Clone the Datasheet Scrubber repository

    git clone git@github.com:idea-fasoc/datasheet-scrubber.git

Database

The FASoC database contains more than 700,000 records of Integrated Circuits (ICs) components collected from Digikey.

Database Web Application

In order to access a sample of this collection, visit our web application or proceed here.

Raw Database

To have access to the entire collection of components, please visit here.

Datasheet-Scrubber

Datasheet scrubber includes three steps of category recognition, table extracton and text extraction.

Test

an example of how to use the table extractor can be found here.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 97.7%
  • JavaScript 1.1%
  • Other 1.2%