Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Container configs #1515

Draft
wants to merge 13 commits into
base: dev
Choose a base branch
from
Draft

Container configs #1515

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
d3f48aa
ci: Add containers_config workflow
edmundmiller Mar 17, 2025
ee28ef2
ci: Give it a matrix
edmundmiller Mar 17, 2025
09a8ce8
ci: Update names
edmundmiller Mar 17, 2025
d082b44
ci: Add commit step
edmundmiller Mar 17, 2025
f44a3b4
ci: Check out with bot auth token and just add containers
edmundmiller Mar 17, 2025
f45a4a4
ci: Checkout pull request HEAD commit instead of merge commit
edmundmiller Mar 17, 2025
36980a3
ci: Try with head_ref
edmundmiller Mar 17, 2025
3a6b4ca
ci: Add a .
edmundmiller Mar 17, 2025
095a515
ci: Run containers snapshot in one step
edmundmiller Mar 17, 2025
4fb7547
ci: Sort the outputs ourselves
edmundmiller Mar 17, 2025
05fe8db
[automated] Update container configs
nf-core-bot Mar 17, 2025
d54bcf9
build: Try locking down some containers
edmundmiller Mar 17, 2025
dd3b67c
[automated] Update container configs
nf-core-bot Mar 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
51 changes: 51 additions & 0 deletions .github/workflows/containers_config.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
name: Container Configs

on:
# FIXME Remove these and only run on release or PRs to main or TEMPLATE updates
push:
branches: [main,dev]
pull_request:
branches: [main,dev]
release:
types: [published]
# TODO workflow_dispatch:

jobs:
build:
runs-on: ubuntu-latest
env:
FORCE_COLOR: 1
steps:
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4
with:
token: ${{ secrets.nf_core_bot_auth_token }}
ref: ${{ github.head_ref }}
- uses: nf-core/setup-nextflow@v2
with:
version: "25.01.0-edge"
- name: Snapshot containers
run: |
mkdir -p conf/containers
for container in docker singularity; do
for arch in amd64 arm64; do
if [ "$arch" = "arm64" ]; then
profile="wave,$container,arm"
else
profile="wave,$container"
fi
nextflow inspect . -profile $profile -format config > conf/containers/containers_${container}_${arch}.config
echo "Created conf/containers/containers_${container}_${arch}.config"
sort -o conf/containers/containers_${container}_${arch}.config conf/containers/containers_${container}_${arch}.config
done
done
- name: Commit & push changes
id: commit-and-push
run: |
git config user.email "[email protected]"
git config user.name "nf-core-bot"
git config push.default upstream
git add conf/containers/.
git status
git commit -m "[automated] Update container configs"
git push

274 changes: 0 additions & 274 deletions conf/arm.config
View file
Open in desktop

This file was deleted.

64 changes: 64 additions & 0 deletions conf/containers/containers_docker_amd64.config
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
process { withName: 'BBMAP_BBSPLIT' { container = 'community.wave.seqera.io/library/bbmap:39.10--168578230ff6490a' } }
process { withName: 'BEDTOOLS_GENOMECOV' { container = 'community.wave.seqera.io/library/bedtools:2.31.1--7c4ce4cb07c09ee4' } }
process { withName: 'BRACKEN_BRACKEN' { container = 'community.wave.seqera.io/library/bracken:2.9--3d5af74ed6966fc1' } }
process { withName: 'CAT_FASTQ' { container = 'community.wave.seqera.io/library/coreutils:9.5--ae99c88a9b28c264' } }
process { withName: 'CUSTOM_CATADDITIONALFASTA' { container = 'community.wave.seqera.io/library/python:3.12.2--8aba3d9ac529ff19' } }
process { withName: 'CUSTOM_GETCHROMSIZES' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'CUSTOM_TX2GENE' { container = 'community.wave.seqera.io/library/python:3.10.4--a643e28963f01eef' } }
process { withName: 'DESEQ2_QC' { container = 'community.wave.seqera.io/library/r-base_r-optparse_r-ggplot2_r-rcolorbrewer_pruned:d06fadc02f8422a2' } }
process { withName: 'DUPRADAR' { container = 'community.wave.seqera.io/library/bioconductor-dupradar:1.32.0--dcb3a3be56be6612' } }
process { withName: 'FASTP' { container = 'community.wave.seqera.io/library/fastp:0.23.4--f8cefc1e5f7a782e' } }
process { withName: 'FASTQC' { container = 'community.wave.seqera.io/library/fastqc:0.12.1--af7a5314d5015c29' } }
process { withName: 'FQ_LINT' { container = 'community.wave.seqera.io/library/fq:0.12.0--45ea0ea1c4d20daa' } }
process { withName: 'FQ_SUBSAMPLE' { container = 'community.wave.seqera.io/library/fq:0.12.0--45ea0ea1c4d20daa' } }
process { withName: 'GFFREAD' { container = 'community.wave.seqera.io/library/gffread:0.12.7--33b95f1cfcc0e572' } }
process { withName: 'GTF2BED' { container = 'community.wave.seqera.io/library/perl:5.26.2--e6570c5f08d3e12c' } }
process { withName: 'GTF_FILTER' { container = 'community.wave.seqera.io/library/python:3.9.5--0ee01a3faebf676a' } }
process { withName: 'GUNZIP' { container = 'community.wave.seqera.io/library/grep_sed_tar:4f61255d5eff93dc' } }
process { withName: 'HISAT2_ALIGN' { container = 'community.wave.seqera.io/library/hisat2_samtools:9ef5e68250d2aa60' } }
process { withName: 'HISAT2_BUILD' { container = 'community.wave.seqera.io/library/hisat2:2.2.1--df34d2bb25ac6de5' } }
process { withName: 'HISAT2_EXTRACTSPLICESITES' { container = 'community.wave.seqera.io/library/hisat2:2.2.1--df34d2bb25ac6de5' } }
process { withName: 'KALLISTO_INDEX' { container = 'community.wave.seqera.io/library/kallisto:0.51.1--b63691b6841c7a52' } }
process { withName: 'KALLISTO_QUANT' { container = 'community.wave.seqera.io/library/kallisto:0.51.1--b63691b6841c7a52' } }
process { withName: 'KRAKEN2_KRAKEN2' { container = 'community.wave.seqera.io/library/kraken2_coreutils_pigz:0892e153c7954635' } }
process { withName: 'MULTIQC' { container = 'community.wave.seqera.io/library/multiqc:1.27--b0d1ffb40dfd9e97' } }
process { withName: 'MULTIQC_CUSTOM_BIOTYPE' { container = 'community.wave.seqera.io/library/python:3.9.5--0ee01a3faebf676a' } }
process { withName: 'PICARD_MARKDUPLICATES' { container = 'community.wave.seqera.io/library/picard:3.1.1--bae6cd265e6bf3d3' } }
process { withName: 'PREPROCESS_TRANSCRIPTS_FASTA_GENCODE' { container = 'community.wave.seqera.io/library/sed:4.7--c9d1b71422302845' } }
process { withName: 'PRESEQ_LCEXTRAP' { container = 'community.wave.seqera.io/library/preseq:3.2.0--2789d8b704b33613' } }
process { withName: 'QUALIMAP_RNASEQ' { container = 'community.wave.seqera.io/library/qualimap:2.3--c1797c2253925b3a' } }
process { withName: 'RSEM_CALCULATEEXPRESSION' { container = 'community.wave.seqera.io/library/rsem_star:5acb4e8c03239c32' } }
process { withName: 'RSEM_MERGE_COUNTS' { container = 'community.wave.seqera.io/library/sed:4.7--c9d1b71422302845' } }
process { withName: 'RSEM_PREPAREREFERENCE' { container = 'community.wave.seqera.io/library/rsem_star:5acb4e8c03239c32' } }
process { withName: 'RSEQC_BAMSTAT' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_INFEREXPERIMENT' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_INNERDISTANCE' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_JUNCTIONANNOTATION' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_JUNCTIONSATURATION' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_READDISTRIBUTION' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_READDUPLICATION' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_TIN' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'SALMON_INDEX' { container = 'community.wave.seqera.io/library/salmon:1.10.3--fcd0755dd8abb423' } }
process { withName: 'SALMON_QUANT' { container = 'community.wave.seqera.io/library/salmon:1.10.3--fcd0755dd8abb423' } }
process { withName: 'SAMTOOLS_FLAGSTAT' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SAMTOOLS_IDXSTATS' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SAMTOOLS_INDEX' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SAMTOOLS_SORT' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SAMTOOLS_STATS' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SORTMERNA' { container = 'community.wave.seqera.io/library/sortmerna:4.3.7--6502243397c065ba' } }
process { withName: 'STAR_ALIGN' { container = 'community.wave.seqera.io/library/htslib_samtools_star_gawk:311d422a50e6d829' } }
process { withName: 'STAR_ALIGN_IGENOMES' { container = 'community.wave.seqera.io/library/star_samtools_gawk:bef5708b1c54889a' } }
process { withName: 'STAR_GENOMEGENERATE' { container = 'community.wave.seqera.io/library/htslib_samtools_star_gawk:311d422a50e6d829' } }
process { withName: 'STAR_GENOMEGENERATE_IGENOMES' { container = 'community.wave.seqera.io/library/star_samtools_gawk:bef5708b1c54889a' } }
process { withName: 'STRINGTIE_STRINGTIE' { container = 'community.wave.seqera.io/library/stringtie:2.2.3--3c30041821e5a79a' } }
process { withName: 'SUBREAD_FEATURECOUNTS' { container = 'community.wave.seqera.io/library/subread:2.0.6--1968a7457b0ed34e' } }
process { withName: 'SUMMARIZEDEXPERIMENT_SUMMARIZEDEXPERIMENT' { container = 'community.wave.seqera.io/library/bioconductor-summarizedexperiment:1.32.0--13051b66560c2065' } }
process { withName: 'TRIMGALORE' { container = 'community.wave.seqera.io/library/cutadapt_trim-galore_pigz:a98edd405b34582d' } }
process { withName: 'TXIMETA_TXIMPORT' { container = 'community.wave.seqera.io/library/bioconductor-tximeta:1.20.1--cd025af46d4ef23a' } }
process { withName: 'UCSC_BEDCLIP' { container = 'community.wave.seqera.io/library/ucsc-bedclip:377--41de764ea1c26af4' } }
process { withName: 'UCSC_BEDGRAPHTOBIGWIG' { container = 'community.wave.seqera.io/library/ucsc-bedgraphtobigwig:469--f66c00635e28f216' } }
process { withName: 'UMICOLLAPSE' { container = 'community.wave.seqera.io/library/umicollapse:1.1.0--74864b350c72f3a0' } }
process { withName: 'UMITOOLS_DEDUP' { container = 'community.wave.seqera.io/library/umi_tools:1.1.5--a4e9770134f31e60' } }
process { withName: 'UMITOOLS_EXTRACT' { container = 'community.wave.seqera.io/library/umi_tools:1.1.5--a4e9770134f31e60' } }
process { withName: 'UMITOOLS_PREPAREFORRSEM' { container = 'community.wave.seqera.io/library/umi_tools:1.1.5--a4e9770134f31e60' } }
process { withName: 'UNTAR' { container = 'community.wave.seqera.io/library/grep_sed_tar:4f61255d5eff93dc' } }
64 changes: 64 additions & 0 deletions conf/containers/containers_docker_arm64.config
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
process { withName: 'BBMAP_BBSPLIT' { container = 'community.wave.seqera.io/library/bbmap:39.10--168578230ff6490a' } }
process { withName: 'BEDTOOLS_GENOMECOV' { container = 'community.wave.seqera.io/library/bedtools:2.31.1--7c4ce4cb07c09ee4' } }
process { withName: 'BRACKEN_BRACKEN' { container = 'community.wave.seqera.io/library/bracken:2.9--3d5af74ed6966fc1' } }
process { withName: 'CAT_FASTQ' { container = 'community.wave.seqera.io/library/coreutils:9.5--ae99c88a9b28c264' } }
process { withName: 'CUSTOM_CATADDITIONALFASTA' { container = 'community.wave.seqera.io/library/python:3.12.2--8aba3d9ac529ff19' } }
process { withName: 'CUSTOM_GETCHROMSIZES' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'CUSTOM_TX2GENE' { container = 'community.wave.seqera.io/library/python:3.10.4--a643e28963f01eef' } }
process { withName: 'DESEQ2_QC' { container = 'community.wave.seqera.io/library/r-base_r-optparse_r-ggplot2_r-rcolorbrewer_pruned:d06fadc02f8422a2' } }
process { withName: 'DUPRADAR' { container = 'community.wave.seqera.io/library/bioconductor-dupradar:1.32.0--dcb3a3be56be6612' } }
process { withName: 'FASTP' { container = 'community.wave.seqera.io/library/fastp:0.23.4--f8cefc1e5f7a782e' } }
process { withName: 'FASTQC' { container = 'community.wave.seqera.io/library/fastqc:0.12.1--af7a5314d5015c29' } }
process { withName: 'FQ_LINT' { container = 'community.wave.seqera.io/library/fq:0.12.0--45ea0ea1c4d20daa' } }
process { withName: 'FQ_SUBSAMPLE' { container = 'community.wave.seqera.io/library/fq:0.12.0--45ea0ea1c4d20daa' } }
process { withName: 'GFFREAD' { container = 'community.wave.seqera.io/library/gffread:0.12.7--33b95f1cfcc0e572' } }
process { withName: 'GTF2BED' { container = 'community.wave.seqera.io/library/perl:5.26.2--e6570c5f08d3e12c' } }
process { withName: 'GTF_FILTER' { container = 'community.wave.seqera.io/library/python:3.9.5--0ee01a3faebf676a' } }
process { withName: 'GUNZIP' { container = 'community.wave.seqera.io/library/grep_sed_tar:4f61255d5eff93dc' } }
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is an linux/amd64 container

$ docker inspect community.wave.seqera.io/library/grep_sed_tar:4f61255d5eff93dc | grep Architecture
        "Architecture": "amd64",

process { withName: 'HISAT2_ALIGN' { container = 'community.wave.seqera.io/library/hisat2_samtools:9ef5e68250d2aa60' } }
process { withName: 'HISAT2_BUILD' { container = 'community.wave.seqera.io/library/hisat2:2.2.1--df34d2bb25ac6de5' } }
process { withName: 'HISAT2_EXTRACTSPLICESITES' { container = 'community.wave.seqera.io/library/hisat2:2.2.1--df34d2bb25ac6de5' } }
process { withName: 'KALLISTO_INDEX' { container = 'community.wave.seqera.io/library/kallisto:0.51.1--b63691b6841c7a52' } }
process { withName: 'KALLISTO_QUANT' { container = 'community.wave.seqera.io/library/kallisto:0.51.1--b63691b6841c7a52' } }
process { withName: 'KRAKEN2_KRAKEN2' { container = 'community.wave.seqera.io/library/kraken2_coreutils_pigz:0892e153c7954635' } }
process { withName: 'MULTIQC' { container = 'community.wave.seqera.io/library/multiqc:1.27--b0d1ffb40dfd9e97' } }
process { withName: 'MULTIQC_CUSTOM_BIOTYPE' { container = 'community.wave.seqera.io/library/python:3.9.5--0ee01a3faebf676a' } }
process { withName: 'PICARD_MARKDUPLICATES' { container = 'community.wave.seqera.io/library/picard:3.1.1--bae6cd265e6bf3d3' } }
process { withName: 'PREPROCESS_TRANSCRIPTS_FASTA_GENCODE' { container = 'community.wave.seqera.io/library/sed:4.7--c9d1b71422302845' } }
process { withName: 'PRESEQ_LCEXTRAP' { container = 'community.wave.seqera.io/library/preseq:3.2.0--2789d8b704b33613' } }
process { withName: 'QUALIMAP_RNASEQ' { container = 'community.wave.seqera.io/library/qualimap:2.3--c1797c2253925b3a' } }
process { withName: 'RSEM_CALCULATEEXPRESSION' { container = 'community.wave.seqera.io/library/rsem_star:5acb4e8c03239c32' } }
process { withName: 'RSEM_MERGE_COUNTS' { container = 'community.wave.seqera.io/library/sed:4.7--c9d1b71422302845' } }
process { withName: 'RSEM_PREPAREREFERENCE' { container = 'community.wave.seqera.io/library/rsem_star:5acb4e8c03239c32' } }
process { withName: 'RSEQC_BAMSTAT' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_INFEREXPERIMENT' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_INNERDISTANCE' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_JUNCTIONANNOTATION' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_JUNCTIONSATURATION' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_READDISTRIBUTION' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_READDUPLICATION' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'RSEQC_TIN' { container = 'community.wave.seqera.io/library/rseqc_r-base:2c6374f25c7b060e' } }
process { withName: 'SALMON_INDEX' { container = 'community.wave.seqera.io/library/salmon:1.10.3--fcd0755dd8abb423' } }
process { withName: 'SALMON_QUANT' { container = 'community.wave.seqera.io/library/salmon:1.10.3--fcd0755dd8abb423' } }
process { withName: 'SAMTOOLS_FLAGSTAT' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SAMTOOLS_IDXSTATS' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SAMTOOLS_INDEX' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SAMTOOLS_SORT' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SAMTOOLS_STATS' { container = 'community.wave.seqera.io/library/htslib_samtools:1.21--6cb89bfd40cbaabf' } }
process { withName: 'SORTMERNA' { container = 'community.wave.seqera.io/library/sortmerna:4.3.7--6502243397c065ba' } }
process { withName: 'STAR_ALIGN' { container = 'community.wave.seqera.io/library/htslib_samtools_star_gawk:311d422a50e6d829' } }
process { withName: 'STAR_ALIGN_IGENOMES' { container = 'community.wave.seqera.io/library/star_samtools_gawk:bef5708b1c54889a' } }
process { withName: 'STAR_GENOMEGENERATE' { container = 'community.wave.seqera.io/library/htslib_samtools_star_gawk:311d422a50e6d829' } }
process { withName: 'STAR_GENOMEGENERATE_IGENOMES' { container = 'community.wave.seqera.io/library/star_samtools_gawk:bef5708b1c54889a' } }
process { withName: 'STRINGTIE_STRINGTIE' { container = 'community.wave.seqera.io/library/stringtie:2.2.3--3c30041821e5a79a' } }
process { withName: 'SUBREAD_FEATURECOUNTS' { container = 'community.wave.seqera.io/library/subread:2.0.6--1968a7457b0ed34e' } }
process { withName: 'SUMMARIZEDEXPERIMENT_SUMMARIZEDEXPERIMENT' { container = 'community.wave.seqera.io/library/bioconductor-summarizedexperiment:1.32.0--13051b66560c2065' } }
process { withName: 'TRIMGALORE' { container = 'community.wave.seqera.io/library/cutadapt_trim-galore_pigz:a98edd405b34582d' } }
process { withName: 'TXIMETA_TXIMPORT' { container = 'community.wave.seqera.io/library/bioconductor-tximeta:1.20.1--cd025af46d4ef23a' } }
process { withName: 'UCSC_BEDCLIP' { container = 'community.wave.seqera.io/library/ucsc-bedclip:377--41de764ea1c26af4' } }
process { withName: 'UCSC_BEDGRAPHTOBIGWIG' { container = 'community.wave.seqera.io/library/ucsc-bedgraphtobigwig:469--f66c00635e28f216' } }
process { withName: 'UMICOLLAPSE' { container = 'community.wave.seqera.io/library/umicollapse:1.1.0--74864b350c72f3a0' } }
process { withName: 'UMITOOLS_DEDUP' { container = 'community.wave.seqera.io/library/umi_tools:1.1.5--a4e9770134f31e60' } }
process { withName: 'UMITOOLS_EXTRACT' { container = 'community.wave.seqera.io/library/umi_tools:1.1.5--a4e9770134f31e60' } }
process { withName: 'UMITOOLS_PREPAREFORRSEM' { container = 'community.wave.seqera.io/library/umi_tools:1.1.5--a4e9770134f31e60' } }
process { withName: 'UNTAR' { container = 'community.wave.seqera.io/library/grep_sed_tar:4f61255d5eff93dc' } }
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is an linux/amd64 container

$ docker inspect community.wave.seqera.io/library/grep_sed_tar:4f61255d5eff93dc | grep Architecture
        "Architecture": "amd64",

Loading
Loading