GitHub - patentnetwork/Python-Scripts: Python Scripts for data pre- and post-processing (parsing, cleaning and analysis)

patentnetwork / Python-Scripts Public

Notifications You must be signed in to change notification settings
Fork 7
Star 13

Python Scripts for data pre- and post-processing (parsing, cleaning and analysis)

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 50 Commits
20100928_class.py		20100928_class.py
B1_Database Create (GNS).py		B1_Database Create (GNS).py
B2_LocationMatch.py		B2_LocationMatch.py
CleanDataset.py		CleanDataset.py
DVN.py		DVN.py
GraphML.py		GraphML.py
README		README
SQLite.py		SQLite.py
XMLParse2008.py		XMLParse2008.py
bmVerify_debug.py		bmVerify_debug.py
bmVerify_v2.py		bmVerify_v2.py
bmVerify_v3.py		bmVerify_v3.py
compressBlk_v6.py		compressBlk_v6.py
createFullSet.py		createFullSet.py
fwork.py		fwork.py
get_invpatC.sh		get_invpatC.sh
igraphSen.py		igraphSen.py
invpat.py		invpat.py
locFunc.py		locFunc.py
mergedata.py		mergedata.py
minimize.py		minimize.py
orgClean.py		orgClean.py
patXML.py		patXML.py
patentYear.py		patentYear.py
scripts_v2.py		scripts_v2.py
senAdd.py		senAdd.py
senGraph.py		senGraph.py

Repository files navigation

PREVIOUS:

bmVerify compares the consolidated results with an existing benchmark

compressBlk takes a "disambiguated" dataset and consolidates it into a new dataset.

fwork.py are Python scripts I reuse

CURRENT:

(I) DATASET PREPARATION

(1) XML Parsing
	a. Open XMLParse2008.py
	b. Set variable flder = <folder that contains all XML raw files>
	c. Run XMLParse2008.py

(2) Data Cleaning
	- scripts_v2.py should be in same directory as all sqlite3 files from XML Parsing step.
	a. Run scripts_v2.py

(3) Table Consolidation
	a. Run invpat.py
	b.

(II) RESULTS ANALYSIS
From the command line, run bmVerify_v3.py.

Use python bmVerify_v3.py ? or python bmVerify_v3.py help for more information.

(III) Other scripts

Run from command line to create files:

python patentYear.py [year] [src]
python createFullSet.py [start_year] [end_year]