1. ENCODE: Encyclopedia of DNA Elements
2. ENCODE Factorbook
3. ChromNet ChIP-seq interactions
   paper: Learning the human chromatin network using all ENCODE ChIP-seq datasets
4. The International Human Epigenome Consortium (IHEC) epigenome data portal
5. GEO. Sequences are in .sra format, need to use sratools to dump into fastq.
6. European Nucleotide Archive. Sequences are available in fastq format.
7. Data bases and software from Sheirly Liu's lab at Harvard
8. Blueprint epigenome
9. A collection of tools and papers for nucelosome positioning and TF ChIP-seq
10. review paper:Deciphering ENCODE

1. ChIP-seq guidelines and practices of the ENCODE and modENCODE consortia

2. Practical Guidelines for the Comprehensive Analysis of ChIP-seq Data

3. Systematic evaluation of factors influencing ChIP-seq fidelity

4. ChIP–seq: advantages and challenges of a maturing technology

5. ChIP–seq and beyond: new and improved methodologies to detect and characterize protein–DNA interactions

6. Beyond library size: a field guide to NGS normalization

7. ENCODE paper portol

8. Enhancer discovery and characterization

9. 2016 review Recent advances in ChIP-seq analysis: from quality management to whole-genome annotation

10. bioinformatics paper:Features that define the best ChIP-seq peak calling algorithms compares different peak callers for TFs and histones.

11. Systematic comparison of monoclonal versus polyclonal antibodies for mapping histone modifications by ChIP-seq The binding patterns for H3K27ac differed substantially between polyclonal and monoclonal antibodies. However, this was most likely due to the distinct immunogen used rather than the clonality of the antibody. Altogether, we found that monoclonal antibodies as a class perform as well as polyclonal antibodies. Accordingly, we recommend the use of monoclonal antibodies in ChIP-seq experiments.

    Protocols

12. A computational pipeline for comparative ChIP-seq analyses

13. Identifying ChIP-seq enrichment using MACS

14. Spatial clustering for identification of ChIP-enriched regions (SICER) to map regions of histone methylation patterns in embryonic stem cells

15. ENCODE tutorials

16. A User's Guide to the Encyclopedia of DNA Elements (ENCODE)

Data downloaded from GEO usually are raw fastq files. One needs to do quality control (QC) on them.

• fastqc
• multiqc Aggregate results from bioinformatics analyses across many samples into a single report. Could be very useful to summarize the QC report.

Be careful with the peaks you get:
Active promoters give rise to false positive ‘Phantom Peaks’ in ChIP-seq experiments

It is good to have controls for your ChIP-seq experiments. A DNA input control (no antibody is applied) is prefered. The IgG control is also fine, but because so little DNA is there, you might get many duplicated reads due to PCR artifact.

For cancer cells, an input control can be used to correct for copy-number bias.

A quote from Tao Liu: who develped MACS1/2

I remember in a PloS One paper last year by Elizabeth G. Wilbanks et al., authors pointed out the best way to sort results in MACS is by -10*log10(pvalue) then fold enrichment. I agree with them. You don't have to worry about FDR too much if your input data are far more than ChIP data. MACS1.4 calculates FDR by swapping samples, so if your input signal has some strong bias somewhere in the genome, your FDR result would be bad. Bad FDR may mean something but it's just secondary.

1. The most popular peak caller by Tao Liu: MACS2. Now --broad flag supports broad peaks calling as well.

2. TF ChIP-seq peak calling using the Irreproducibility Discovery Rate (IDR) framework and many Software Tools Used to Create the ENCODE Resource

3. SICER for broad histone modification ChIP-seq

4. HOMER can also used to call Transcription factor ChIP-seq peaks and histone modification ChIP-seq peaks.

5. MUSIC

6. permseq R package for mapping protein-DNA interactions in highly repetitive regions of the genomes with prior-enhanced read mapping. Paper on PLos Comp.

7. Ritornello: High fidelity control-free chip-seq peak calling. No input is required!

8. Tumor samples are heterogeneous containing different cell types. MixChIP: a probabilistic method for cell type specific protein-DNA binding analysis

9. Detecting broad domains and narrow peaks in ChIP-seq data with hiddenDomains tool

10. BroadPeak: a novel algorithm for identifying broad peaks in diffuse ChIP-seq datasets

11. epic: diffuse domain ChIP-Seq caller based on SICER. It is a re-writen of SICER for faster processing using more CPUs. (Will try it for broad peak for sure).

12. Cistrome: The best place for wet lab scientist to check the binding sites. Developed by Shierly Liu lab in Harvard.

Different parameters using the same program can produce drastic different sets of peaks especially for histone modifications with variable enrichment length and gaps between peaks. One needs to make a valid argument for parameters he uses

An example of different parameters for homer findPeaks:

• A significant proportion of transcription-factor binding sites may be nonfunctional A post from Judge Starling

• Several papers have shown that changes of adjacent TF binding poorly correlates with gene expression change: Extensive Divergence of Transcription Factor Binding in Drosophila Embryos with Highly Conserved Gene Expression
  Transcription Factors Bind Thousands of Active and Inactive Regions in theDrosophila Blastoderm

The Functional Consequences of Variation in Transcription Factor Binding

" On average, 14.7% of genes bound by a factor were differentially expressed following the knockdown of that factor, suggesting that most interactions between TF and chromatin do not result in measurable changes in gene expression levels of putative target genes. "

• paper A large portion of the ChIP-seq signal does not correspond to true binding
• BIDCHIPS: Bias-Decomposition of ChIP-seq Signals
  mappability, GC-content and chromatin accessibility affect ChIP-seq read counts.
• ChIP bias as a function of cross-linking time

We analyzed the dependence of the ChIP signal on the duration of formaldehyde cross-linking time for two proteins: DNA topoisomerase 1 (Top1) that is functionally associated with the double helix in vivo, especially with active chromatin, and green fluorescent protein (GFP) that has no known bona fide interactions with DNA. With short time of formaldehyde fixation, only Top1 immunoprecipation efficiently recovered DNA from active promoters, whereas prolonged fixation augmented non-specific recovery of GFP dramatizing the need to optimize ChIP protocols to minimize the time of cross-linking, especially for abundant nuclear proteins. Thus, ChIP is a powerful approach to study the localization of protein on the genome when care is taken to manage potential artifacts.

1. Broad Enrich
2. ChIP Enrich
3. GREAT predicts functions of cis-regulatory regions.
4. ENCODE ChIP-seq significance tool. Given a list of genes, co-regulating TFs will be identified.
5. cscan similar to the ENCODE significance tool.
6. CompGO: an R package for comparing and visualizing Gene Ontology enrichment differences between DNA binding experiments
7. interactive and collaborative HTML5 gene list enrichment analysis tool
8. GeNets from Broad. Looks very promising.
9. Bioconductor EnrichmentBrowser
10. clusterProfiler by Guangchuan Yu, the author of ChIPseeker.
11. fgsea bioconductor package Fast Gene Set Entrichment Analysis.
12. paper: A Comparison of Gene Set Analysis Methods in Terms of Sensitivity, Prioritization and Specificity

1. ChromHMM from Manolis Kellis in MIT.

In ChromHMM the raw reads are assigned to non-overlapping bins of 200 bps and a sample-specific threshold is used to transform the count data to binary values

2. Segway from Hoffman lab. Base pair resolution. Takes longer time to run.
3. epicseg published 2015 in genome biology. Similiar speed with ChromHMM.
4. Spectacle: fast chromatin state annotation using spectral learning. Also published 2015 in genome biology.
5. chromstaR: Tracking combinatorial chromatin state dynamics in space and time
6. epilogos visualization and analysis of chromatin state model data.
7. Accurate promoter and enhancer identification in 127 ENCODE and Roadmap Epigenomics cell types and tissues by GenoSTAN

1. Homer annotatePeak
2. Bioconductor package ChIPseeker by Guangchuan Yu
   See an important post by him on 0 or 1 based coordinates.

Most of the software for ChIP annotation doesn't considered this issue when annotating peak (0-based) to transcript (1-based). To my knowledge, only HOMER consider this issue. After I figure this out, I have updated ChIPseeker (version >= 1.4.3) to fix the issue.

3. Bioconductor package ChIPpeakAnno. There is a bug with this package, not sure if it is solved or not. Still a post from Guangchuan Yu: Bug of R package ChIPpeakAnno.

I used R package ChIPpeakAnno for annotating peaks, and found that it handle the DNA strand in the wrong way. Maybe the developers were from the computer science but not biology background.

4. annotatr Annotation of Genomic Regions to Genomic Annotations

• DNAshapeR predicts DNA shape features in an ultra-fast, high-throughput manner from genomic sequencing data

Look at a post and here describing different tools. A review paper A comprehensive comparison of tools for differential ChIP-seq analysis

1. MultiGPS

2. PePr. It can also call peaks.

3. histoneHMM

4. diffreps for histone. developed by Shen Li's lab in Mount Sinai who also develped ngs.plot.

5. diffbind bioconductor package. Internally uses RNA-seq tools: EdgR or DESeq. Most likely, I will use this tool.

6. ChIPComp. Very little tutorial. Now it is on bioconductor.

7. csaw bioconductor package. Tutorial here

8. chromDiff. Also from from Manolis Kellis in MIT. Similar with ChromHMM, documentation is not that detailed. Will have a try on this.

9. MACS2 can detect differential peaks as well

10. paper Identifying differential transcription factor binding in ChIP-seq

1. HOMER. It has really detailed documentation. It can also be used to call peaks.

For TF ChIP-seq, one can usually find the summit of the peak (macs14 will report the summit), and extend the summit to both sides to 100bp-500bp. One can then use those 100bp-500 bp small regions to do motif analysis. Usually, oen should find the motif for the ChIPed TF in the ChIP-seq experiment if it is a DNA binding protein.

It is trickier to do motif analysis using histone modification ChIP-seq. For example, the average peak size of H3K27ac is 2~3 kb. If one wants to find TF binding motifs from H3K27ac ChIP-seq data, it is good to narrow down the region a bit. MEME and many other motif finding tools require that the DNA sequence length to be small (~500bp). One way is to use findPeaks in homer turning on -nfr(nucleosome free region) flag, and then do motif analysis in those regions.

suggestions for finding motifs from histone modification ChIP-seq data from HOMER page:

Since you are looking at a region, you do not necessarily want to center the peak on the specific position with the highest tag density, which may be at the edge of the region. Besides, in the case of histone modifications at enhancers, the highest signal will usually be found on nucleosomes surrounding the center of the enhancer, which is where the functional sequences and transcription factor binding sites reside. Consider H3K4me marks surrounding distal PU.1 transcription factor peaks. Typically, adding the -center >option moves peaks further away from the functional sequence in these scenarios.

Other strategy similar to -nfr was developed in this paper: Dissecting neural differentiation regulatory networks through epigenetic footprinting. In the method part of the paper, the authors computed a depletion score within the peaks, and use the footprinted regions to do motif analysis. (Thanks kadir for pointing out the paper)

I just found PARE. PARE is a computational method to Predict Active Regulatory Elements, specifically enhancers and promoters. H3K27ac and H3K4me can be used to define active enhancers.

2. MEME suite. It is probably the most popular motif finding tool in the papers. protocol:Motif-based analysis of large nucleotide data sets using MEME-ChIP
3. JASPAR database
4. pScan-ChIP
5. MotifMap
6. RAST Regulatory Sequence Analysis Tools.
7. ENCODE TF motif database
8. oPOSSUM is a web-based system for the detection of over-represented conserved transcription factor binding sites and binding site combinations in sets of genes or sequences.
9. my post how to get a genome-wide motif bed file
10. Many other tools here
11. A review of ensemble methods for de novo motif discovery in ChIP-Seq data
12. melina2. If you only have one sequence and want to know what TFs might bind there, this is a very useful tool.
13. STEME. A python library for motif analysis. STEME started life as an approximation to the Expectation-Maximisation algorithm for the type of model used in motif finders such as MEME. STEME’s EM approximation runs an order of magnitude more quickly than the MEME implementation for typical parameter settings. STEME has now developed into a fully-fledged motif finder in its own right.
14. CENTIPEDE: Transcription factor footprinting and binding site prediction. Tutorial
15. msCentipede: Modeling Heterogeneity across Genomic Sites and Replicates Improves Accuracy in the Inference of Transcription Factor Binding
16. DiffLogo: A comparative visualisation of sequence motifs
17. Weeder (version: 2.0)
18. MCAST: scanning for cis-regulatory motif clusters Part of MEME suite.
19. Sequence-based Discovery of Regulons iRegulon detects the TF, the targets and the motifs/tracks from a set of genes.
20. Regulatory genomic toolbox

The fancy "supper-enhancer" term was first introduced by Richard Young in Whitehead Institute. Basically, super-enhancers are enhancers that span large genomic regions(~12.5kb). The concept of super-enhancer is not new. One of the most famous example is the Locus Control Region (LCR) that controls the globin gene expression, and this has been known for decades.

A review in Nature Genetics What are super-enhancers?

From the HOMER page How finding super enhancers works:

Super enhancer discovery in HOMER emulates the original strategy used by the Young lab. First, peaks are found just like any other ChIP-Seq data set. Then, peaks found within a given distance are 'stitched' together into larger regions (by default this is set at 12.5 kb). The super enhancer signal of each of these regions is then determined by the total normalized number reads minus the number of normalized reads in the input. These regions are then sorted by their score, normalized to the highest score and the number of putative enhancer regions, and then super enhancers are identified as regions past the point where the slope is greater than 1.

Example of a super enhancer plot:

In the plot above, all of the peaks past 0.95 or so would be considered "super enhancers", while the one's below would be "typical" enhancers. If the slope threshold of 1 seems arbitrary to you, well... it is! This part is probably the 'weakest link' in the super enhancer definition. However, the concept is still very useful. Please keep in mind that most enhancers probably fall on a continuum between typical and super enhancer status, so don't bother fighting over the precise number of super enhancers in a given sample and instead look for useful trends in the data.

Using ROSE from Young lab
ROSE: RANK ORDERING OF SUPER-ENHANCERS

WiggleTools
bigwig tool
bigwig-python
samtools
bedtools my all-time favorite tool from Araon Quinlan' lab. Great documentation!
Hosting bigWig for UCSC visualization
My first play with GRO-seq data, from sam to bedgraph for visualization
convert bam file to bigwig file and visualize in UCSC genome browser in a Box (GBiB)

The genomic association tester (GAT)
poverlap from Brent Pedersen. Now he is working with Aaron Quinlan at university of Utah.
Genometric Correlation (GenometriCorr): an R package for spatial correlation of genome-wide interval datasets
Location overlap analysis for enrichment of genomic ranges bioconductor package.
regioneR Association analysis of genomic regions based on permutation tests similaRpeak: Metrics to estimate a level of similarity between two ChIP-Seq profiles

Beta from Shirley Liu's lab in Harvard. Tao Liu's previous lab.

Many papers draw meta-plot and heatmap on certain genomic regions (2kb around TSS, genebody etc) using ChIP-seq data.

See an example from the ngs.plot:

Tools

1. deeptools.It can do many others and have good documentation. It can also generate the heatmaps, but I personally use ngs.plot which is esy to use. (developed in Mount Sinai).

2. you can also draw heatmaps using R. just count (using either Homer or bedtools) the ChIP-seq reads in each bin and draw with heatmap.2 function. here and here. Those are my pretty old blog posts, I now have a much better idea on how to make those graphs from scratch.

3. You can also use bioconductor Genomation. It is very versatile.

4. ChAsE

5. Metaseq

6. EnrichedHeatmaps from Zuguang Gu based on his own package ComplexHeatmaps. This is now my default go-to because of the flexiability of the package and the great user support. Thx!

7. A biostar post discussing the tools: Visualizations of ChIP-Seq data using Heatmaps

One cavet is that the meta-plot (on the left) is an average view of ChIP-seq tag enrichment and may not reflect the real biological meaning for individual cases.

See a post from Lior Patcher How to average genome-wide data

I replied the post:

for ChIP-seq, in addition to the average plot, a heatmap that with each region in each row should make it more clear to compare (although not quantitatively). a box-plot (or a histogram) is better in this case . I am really uncomfortable averaging the signal, as a single value (mean) is not a good description of the distribution.

By Meromit Singer:

thanks for the paper ref! Indeed, an additional important issue with averaging is that one could be looking at the aggregation of several (possibly very distinct) clusters. Another thing we should all keep in mind if we choose to make such plots..

A paper from Genome Research Ubiquitous heterogeneity and asymmetry of the chromatin environment at regulatory elements

• FANTOM project CAGE for promoters and enhancers.
• DENdb: database of integrated human enhancers
• VISTA enhancer browser
• Super-enhancer database
• Genome-wide identification and characterization of HOT regions in the human genome

• Multiplex enhancer-reporter assays uncover unsophisticated TP53 enhancer logic

• Assessing Computational Methods for Transcription Factor Target Gene Identification Based on ChIP-seq Data
• Protein binding and methylation on looping chromatin accurately predict distal regulatory interactions
• i-cisTarget
• protocol iRegulon and i-cisTarget: Reconstructing Regulatory Networks Using Motif and Track Enrichment
• Model-based Analysis of Regulation of Gene Expression: MARGE from Shirley Liu's lab. MARGE is a robust methodology that leverages a comprehensive library of genome-wide H3K27ac ChIP-seq profiles to predict key regulated genes and cis-regulatory regions in human or mouse.

• WASP: allele-specific software for robust molecular quantitative trait locus discovery
• ABC -- (Allele-specific Binding from ChIP-Seq)

• RegulomeDB Use RegulomeDB to identify DNA features and regulatory elements in non-coding regions of the human genome by entering dbSNP id, chromosome regions or single Nucleotides.
• motifbreakR A Package For Predicting The Disruptiveness Of Single Nucleotide Polymorphisms On Transcription Factor Binding Sites.
• GERV: A Statistical Method for Generative Evaluation of Regulatory Variants for Transcription Factor Binding From the same group as above.
• PRIME: Predicted Regulatory Impact of a Mutation in an Enhancer
• paper: Which Genetics Variants in DNase-Seq Footprints Are More Likely to Alter Binding? website
• paper: Large-scale identification of sequence variants influencing human transcription factor occupancy in vivo
• A Sicence paper:Survey of variation in human transcription factors reveals prevalent DNA binding changes
• paper Estimating the functional impact of INDELs in transcription factor binding sites: a genome-wide landscape

• In-silico Search for co-occuring transcription factors: INSECT
• INSECT 2
• CO-factors associated with Uniquely-bound GEnomic Regions:COUGER

• bioconductor annotation package phastCons100way.UCSC.hg19 see this post how to use it.

methylPipe and compEpiTools: a suite of R packages for the integrative analysis of epigenomics data

Copy number information from targeted sequencing using off-target reads bioconductor CopywriteR package.

3CPET: Finding Co-factor Complexes in Chia-PET experiment using a Hierarchical Dirichlet Process

• RASQUAL (Robust Allele Specific QUAntification and quality controL) maps QTLs for sequenced based cellular traits by combining population and allele-specific signals. paper: Fine-mapping cellular QTLs with RASQUAL and ATAC-seq
• ATAC-seq Forum
• Single-cell ATAC-Seq
• Global Prediction of Chromatin Accessibility Using RNA-seq from Small Number of Cells from RNA-seq to DNA accessibility. tool on github
• NucleoATAC:Python package for calling nucleosomes using ATAC-Seq data

• pyDNase - a library for analyzing DNase-seq data. paper: Wellington-bootstrap: differential DNase-seq footprinting identifies cell-type determining transcription factors
• paper: Analysis of computational footprinting methods for DNase sequencing experiments tool
• Two nature prime: Genome-wide footprinting: ready for prime time? Genomic footprinting
• PING biocondcutor package: Probabilistic inference for Nucleosome Positioning with MNase-based or Sonicated Short-read Data
• Basset Convolutional neural network analysis for predicting DNA sequence activity]

• TopDom : An efficient and Deterministic Method for identifying Topological Domains in Genomes
• DBPnet: Inferring cooperation of DNA binding proteins in 3D genome
• [Systematic identification of cooperation between DNA binding proteins in 3D space](Systematic identification of cooperation between DNA binding proteins in 3D space)
• DiffHiC package maintained by Aaron Lun, who is the author of csaw and InteractionSet as well.
• protocol:Practical Analysis of Genome Contact Interaction Experiments
• 4D genome: a general repository for chromatin interaction data
• Computational Identification of Genomic Features That Influence 3D Chromatin Domain Formation
• Feng Yue's lab in PSU developed tools for Hi-C, 4C
• QuIN: A Web Server for Querying and Visualizing Chromatin Interaction Networks
• paper: Three-dimensional disorganization of the cancer genome occurs coincident with long-range genetic and epigenetic alterations