eln-infra-ops

An internal infrastructure foundation that reproduces our home CI server fleet from code. It bases pass/fail decisions on real-machine kill-tests rather than design documents, ensuring uninterrupted availability even during failures.

Overview



An internal infrastructure foundation that reproduces and operates our CI server fleet from code. Instead of manual SSH work, server provisioning and service startup are managed with Ansible, Docker Compose, and Terraform / OpenTofu. The CI workflow templates distributed to each repository are also provided by this platform.

Operational goal



The goal is full-HA across every service — commander, Portal, DefectDojo, OpenSearch, monitoring (Grafana/Prometheus), secrets, and runners — so that if any single node goes down, the remaining nodes keep everything running without downtime. Pass/fail is judged not by design documents but by real kill-tests: stopping one node and verifying that every endpoint still responds, no data is lost, and no split-brain occurs.

Key Features

CI/CD Platform

Provides ×10 org self-hosted runners (light/docker/security), security-pr/main/scheduled workflows, Dependabot, and DefectDojo vulnerability ledger integration.

Observability

A monitoring stack of Grafana, Loki, Prometheus, Alertmanager (Slack + email), Tempo + Alloy (OTel), node_exporter, cAdvisor, and Promtail.

Full-text Search & Logging

OpenSearch and Dashboards deliver log ingestion via Vector (importance-based sampling) and ISM retention.

Security Scanning

Semgrep, Trivy, Gitleaks, CodeQL, and Safe Chain are built into runner images and workflows.

AWS Log Platform

S3, Glue (partition projection), Athena, and IAM, with a verified log path from Firehose through S3 to Athena.

Access Control

Cloudflare Access (GitHub login) controls access to graph, DefectDojo, and kibana.eln.ne.jp (Grafana uses JWT SSO, DefectDojo uses two layers, Dashboards uses Access only).

Status: Internal use

See other products

Contact us about eln-infra-ops

Feel free to contact us with any questions about adoption or integration.