Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Statistics pipe #10

Open
wants to merge 72 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 52 commits
Commits
Show all changes
72 commits
Select commit Hold shift + click to select a range
336370e
first commit
ens-ftricomi Apr 12, 2024
877060a
small fixes
ens-ftricomi Apr 12, 2024
04a95dc
fix in config
ens-ftricomi Apr 12, 2024
dbf48dd
moved config in main dir
ens-ftricomi Apr 12, 2024
3bd21b7
added subworkflow configs
ens-ftricomi Apr 12, 2024
f2d318f
parameters fix
ens-ftricomi Apr 12, 2024
e9f7feb
fix false upper case
ens-ftricomi Apr 12, 2024
ef5bc79
fixed parameters
ens-ftricomi Apr 12, 2024
7a3375b
error clean cache
ens-ftricomi Apr 12, 2024
866de80
bug fix busco workflow
ens-ftricomi Apr 12, 2024
268dc22
adjust path for config
ens-ftricomi Apr 12, 2024
f68323d
wrong module name
ens-ftricomi Apr 12, 2024
535bce5
install dependencies
ens-ftricomi Apr 12, 2024
803f4d9
wrong path
ens-ftricomi Apr 12, 2024
8c315b0
replaced take with input
ens-ftricomi Apr 12, 2024
b1d11e0
bug fix busco output
ens-ftricomi Apr 12, 2024
bcc7819
typo in varaiable declaration
ens-ftricomi Apr 12, 2024
3231ba7
fix variable declarations
ens-ftricomi Apr 12, 2024
5bf80d5
removed double quotes
ens-ftricomi Apr 12, 2024
3812837
fixed config parameters
ens-ftricomi Apr 27, 2024
f55f156
fixed channels, busco commands, internal functions to get information…
ens-ftricomi Apr 27, 2024
e467a58
omark subpipeline: fixed channels, internal functions to get informat…
ens-ftricomi Apr 27, 2024
ff3a189
fetch file: fixed channels, internal functions to get information fro…
ens-ftricomi Apr 27, 2024
cdc57f5
busco pipeline: redefined channels, defined parallelisation
ens-ftricomi Apr 27, 2024
69a346d
omark pipeline: redefined channels, defined parallelisation
ens-ftricomi Apr 27, 2024
cdf341d
renamed main
ens-ftricomi Apr 27, 2024
6d072f6
added bin folder for scripts
ens-ftricomi Apr 27, 2024
d28d4b2
added lib folder for mysql jar
ens-ftricomi Apr 27, 2024
dbad198
first commit ensembl statistics
ens-ftricomi Apr 27, 2024
eb69010
changed order of the channels
ens-ftricomi Apr 27, 2024
6aec0ff
tested copy on ftp
ens-ftricomi Apr 27, 2024
5acf65d
core statistics pipeline
ens-ftricomi Apr 28, 2024
fb5079d
fix wrong output dir
ens-ftricomi Apr 28, 2024
5204fdc
blank space
ens-ftricomi Apr 28, 2024
30fac83
fix omark file renaming
ens-ftricomi Apr 28, 2024
326559e
upload stats in ftp
ens-ftricomi Apr 28, 2024
7d08daf
cleaning
ens-ftricomi Apr 28, 2024
0edb7be
add maxForks for busco singularity
ens-ftricomi May 13, 2024
cf850a1
add maxForks to fetch data
ens-ftricomi May 13, 2024
20b2af5
added maxForks to the singularity, fixed omark output name
ens-ftricomi May 13, 2024
539c402
commented channel print
ens-ftricomi May 13, 2024
d582fbf
cleaning, added core_meta_updates repo, tentative to add maxForks dir…
ens-ftricomi May 13, 2024
56cf2f6
added maxFork to reduce interaction with dbs
ens-ftricomi May 13, 2024
ed6c2ac
fixed permissions for statistics dir in the ftp
ens-ftricomi May 13, 2024
5c7a9d6
added README
ens-ftricomi May 13, 2024
229ae5c
missing link for repo
ens-ftricomi May 13, 2024
b05cdc6
specified header
ens-ftricomi May 15, 2024
96645b8
added busco dataset param
ens-ftricomi May 16, 2024
a992df4
added dataset option and adjusted clade selector using taxonomy id an…
ens-ftricomi Jun 23, 2024
74cc47d
fixed busco dataset in a tuple
ens-ftricomi Jun 27, 2024
bbabbee
added plot
ens-ftricomi Aug 6, 2024
923a05f
replaced diagram image
ens-ftricomi Aug 6, 2024
9c5fe20
cleaning
ens-ftricomi Aug 14, 2024
aae5447
force copy in the ftp
ens-ftricomi Sep 20, 2024
d2bd020
added busco miniprot version
ens-ftricomi Sep 20, 2024
e09ab26
script to get busco scores, prepare json and patches for core
ens-ftricomi Sep 23, 2024
8069f1e
apply busco patches to the core
ens-ftricomi Sep 25, 2024
b3e7196
ignore metakeys already present
ens-ftricomi Sep 27, 2024
09775e1
module for loading busco score
ens-ftricomi Sep 27, 2024
c7171b3
added option for applying patches
ens-ftricomi Sep 27, 2024
6ce34d7
bug fixed python docker image
ens-ftricomi Sep 27, 2024
1ba1e40
tested busco patches
ens-ftricomi Sep 27, 2024
4c71103
removed print statements
ens-ftricomi Sep 27, 2024
13cb49e
added repo required in enscode
ens-ftricomi Oct 1, 2024
aa57d6e
added python script to run beta metakeys, added options in the pipeli…
ens-ftricomi Oct 3, 2024
4e52a16
bugfix wrong db name
ens-ftricomi Oct 3, 2024
3edf65a
cleaned unused files
ens-ftricomi Oct 3, 2024
74c2a51
cleaned unused files
ens-ftricomi Oct 3, 2024
608ff3f
updated help
ens-ftricomi Oct 3, 2024
846789e
cleaned unused modules
ens-ftricomi Oct 3, 2024
87471e3
update option documentation
ens-ftricomi Oct 3, 2024
8996274
updated plot
ens-ftricomi Oct 4, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 33 additions & 0 deletions .github/workflows/documentation.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
name: Docs
on: [push, pull_request, workflow_dispatch]
permissions:
contents: write
jobs:
docs:
runs-on: ubuntu-latest
steps:
- name: Checkout Repository
uses: actions/checkout@v2

- name: Set up Python
uses: actions/setup-python@v2
with:
python-version: 3.9

- name: Install Dependencies
run: |
pip install -e.
pip install sphinx sphinx_rtd_theme

- name: Sphinx Build
run: |
sphinx-build -b html docs/source docs/build
sphinx-build docs/source -W -b linkcheck -d docs/build/doctrees docs/build/html
- name: Deploy to GitHub Pages
uses: peaceiris/actions-gh-pages@v3
if: ${{ github.event_name == 'push' && github.ref == 'refs/heads/nextflow_pipe' }}
with:
publish_branch: gh-pages
github_token: ${{ secrets.GITHUB_TOKEN }}
publish_dir: docs/build
force_orphan: true
138 changes: 138 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,138 @@
# Byte-compiled / optimized / DLL files
__pycache__/
*.py[cod]
*$py.class

# C extensions
*.so

# Distribution / packaging
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
MANIFEST

# PyInstaller
# Usually these files are written by a python script from a template
# before PyInstaller builds the exe, so as to inject date/other infos into it.
*.manifest
*.spec

# Installer logs
pip-log.txt
pip-delete-this-directory.txt

# Unit test / coverage reports
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
.cache
nosetests.xml
coverage.xml
*.cover
*.py,cover
.hypothesis/
.pytest_cache/
cover/

# Translations
*.mo
*.pot

# Django stuff:
*.log
local_settings.py
db.sqlite3
db.sqlite3-journal

# Flask stuff:
instance/
.webassets-cache

# Scrapy stuff:
.scrapy

# Sphinx documentation
docs/_build/

# PyBuilder
.pybuilder/
target/

# Jupyter Notebook
.ipynb_checkpoints

# IPython
profile_default/
ipython_config.py

# pyenv
# For a library or package, you might want to ignore these files since the code is
# intended to run in multiple environments; otherwise, check them in:
# .python-version

# pipenv
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
# However, in case of collaboration, if having platform-specific dependencies or dependencies
# having no cross-platform support, pipenv may install dependencies that don't work, or not
# install all needed dependencies.
#Pipfile.lock

# PEP 582; used by e.g. github.com/David-OConnor/pyflow
__pypackages__/

# Celery stuff
celerybeat-schedule
celerybeat.pid

# SageMath parsed files
*.sage.py

# Environments
.env
.venv
env/
venv/
ENV/
env.bak/
venv.bak/

# Spyder project settings
.spyderproject
.spyproject

# Rope project settings
.ropeproject

# mkdocs documentation
/site

# mypy
.mypy_cache/
.dmypy.json
dmypy.json

# Pyre type checker
.pyre/

# pytype static type analyzer
.pytype/

# Cython debug symbols
cython_debug/
5 changes: 5 additions & 0 deletions NOTICE
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
Ensembl
Copyright 2020-2022 EMBL-European Bioinformatics Institute

This product includes software developed at:
- EMBL-European Bioinformatics Institute
Loading
Loading