Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/profile-validate.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ jobs:
https://github.com/Edge-Computing-LLM/edge-cli \
https://github.com/Edge-Computing-LLM/k3s-nvidia-edge \
https://github.com/Edge-Computing-LLM/llm-observability-stack \
https://github.com/Edge-Computing-LLM/qwen-gguf-observability \
https://github.com/Edge-Computing-LLM/gguf-observability \
https://github.com/Edge-Computing-LLM/edge-llm-tests; do
curl --fail --location --silent --show-error --output /dev/null "$url"
done
Expand Down
2 changes: 1 addition & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ safe. Start by choosing the repository that owns the change.
| Unified install, status, validation, logs, or orchestration | [`edge-cli`](https://github.com/Edge-Computing-LLM/edge-cli) |
| Ubuntu, k3s, NVIDIA runtime, GPU Operator, device plugin, or DCGM substrate | [`k3s-nvidia-edge`](https://github.com/Edge-Computing-LLM/k3s-nvidia-edge) |
| Ollama, GGUF, WebUI, OpenTelemetry, Prometheus, Grafana, Helm profiles, or benchmarks | [`llm-observability-stack`](https://github.com/Edge-Computing-LLM/llm-observability-stack) |
| Read-only Qwen runtime contract or evidence schema | [`qwen-gguf-observability`](https://github.com/Edge-Computing-LLM/qwen-gguf-observability) |
| Read-only GGUF model runtime contract or evidence schema | [`gguf-observability`](https://github.com/Edge-Computing-LLM/gguf-observability) |
| Cross-repository validation and sanitized test reports | [`edge-llm-tests`](https://github.com/Edge-Computing-LLM/edge-llm-tests) |
| Organization profile or shared community metadata | [`.github`](https://github.com/Edge-Computing-LLM/.github) |

Expand Down
2 changes: 1 addition & 1 deletion PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

## Owning layer

<!-- edge-cli, k3s-nvidia-edge, llm-observability-stack, qwen-gguf-observability, edge-llm-tests, or organization profile -->
<!-- edge-cli, k3s-nvidia-edge, llm-observability-stack, gguf-observability, edge-llm-tests, or organization profile -->

## Validation

Expand Down
2 changes: 1 addition & 1 deletion SUPPORT.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ Use the repository that owns the affected layer:
- control-plane commands and ordering: [`edge-cli`](https://github.com/Edge-Computing-LLM/edge-cli/issues);
- Ubuntu, k3s, or NVIDIA infrastructure: [`k3s-nvidia-edge`](https://github.com/Edge-Computing-LLM/k3s-nvidia-edge/issues);
- Ollama, WebUI, Helm, or telemetry: [`llm-observability-stack`](https://github.com/Edge-Computing-LLM/llm-observability-stack/issues);
- Qwen runtime evidence: [`qwen-gguf-observability`](https://github.com/Edge-Computing-LLM/qwen-gguf-observability/issues);
- GGUF model runtime evidence: [`gguf-observability`](https://github.com/Edge-Computing-LLM/gguf-observability/issues);
- test harness or report format: [`edge-llm-tests`](https://github.com/Edge-Computing-LLM/edge-llm-tests/issues).

Before opening an issue, search existing issues and read the repository's
Expand Down
21 changes: 21 additions & 0 deletions assets/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
# Edge Computing LLM media library

This directory is the canonical home for first-party organization images and
other publishable multimedia used by Edge Computing LLM.

| Asset | Purpose | Dimensions | SHA-256 |
|---|---|---:|---|
| `edge-llm-hero.png` | Organization profile hero | 1983×793 | `e0441b8aab1e2187ee01e14850abe216cb5068bffee60261ac7e610855602777` |
| `edge-llm-avatar-v2.png` | Current GitHub organization avatar | 1254×1254 | `9e1e83b04733bf1369065ac65bafd59e02da23b4ed053d5acd629dd7258e7e62` |
| `edge-llm-avatar.png` | Detailed alternate avatar concept | 1254×1254 | `361b741df53cbdaf8416c65c8d95d0c5ffab6c87e9feb5d8f3f19842703add53` |

There are currently no first-party videos or audio files. Add future profile
screenshots, diagrams, demonstrations, or recordings here with descriptive,
lowercase filenames. Document their source, purpose, license, creation date,
and checksum in this catalog.

Do not copy media from vendored Helm charts, dashboard-template candidates,
dependency environments, backups, or unrelated event directories into this
library. Those files belong to their upstream projects and may carry different
licenses. Do not store screenshots containing host addresses, tokens, private
prompts, model responses, usernames, or other unsanitized runtime data.
2 changes: 1 addition & 1 deletion docs/ORGANIZATION-OPERATIONS.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ table whenever the organization positioning changes.
| Field | Current value | Rationale |
|---|---|---|
| Display name | Edge Computing LLM | Human-readable form of the organization name. |
| Description | Go-first private LLM infrastructure and observability for Ubuntu, k3s, NVIDIA GPUs, and constrained edge systems | Matches the repository portfolio and deployed target platform. |
| Description | Go-first private multi-model LLM infrastructure and observability for Ubuntu, k3s, NVIDIA GPUs, and constrained edge systems | Matches the repository portfolio and deployed target platform. |
| URL | `https://github.com/Edge-Computing-LLM/.github#readme` | Sends visitors to the maintained organization overview until a dedicated organization website exists. |
| Location | Lahore, Pakistan | Matches the organization owner's published GitHub location. |
| X / Twitter | `https://twitter.com/waqasm86` | Matches the organization owner's published GitHub social handle. |
Expand Down
19 changes: 10 additions & 9 deletions profile/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@
<a href="https://github.com/Edge-Computing-LLM/edge-cli/actions/workflows/validate.yaml"><img alt="edge-cli CI" src="https://github.com/Edge-Computing-LLM/edge-cli/actions/workflows/validate.yaml/badge.svg?branch=main"></a>
<a href="https://github.com/Edge-Computing-LLM/k3s-nvidia-edge/actions/workflows/validate.yaml"><img alt="k3s-nvidia-edge CI" src="https://github.com/Edge-Computing-LLM/k3s-nvidia-edge/actions/workflows/validate.yaml/badge.svg?branch=main"></a>
<a href="https://github.com/Edge-Computing-LLM/llm-observability-stack/actions/workflows/helm-validate.yaml"><img alt="llm-observability-stack CI" src="https://github.com/Edge-Computing-LLM/llm-observability-stack/actions/workflows/helm-validate.yaml/badge.svg?branch=main"></a>
<a href="https://github.com/Edge-Computing-LLM/qwen-gguf-observability/actions/workflows/validate.yaml"><img alt="qwen-gguf-observability CI" src="https://github.com/Edge-Computing-LLM/qwen-gguf-observability/actions/workflows/validate.yaml/badge.svg?branch=main"></a>
<a href="https://github.com/Edge-Computing-LLM/gguf-observability/actions/workflows/validate.yaml"><img alt="gguf-observability CI" src="https://github.com/Edge-Computing-LLM/gguf-observability/actions/workflows/validate.yaml/badge.svg?branch=main"></a>
<a href="https://github.com/Edge-Computing-LLM/edge-llm-tests/actions/workflows/validate.yaml"><img alt="edge-llm-tests CI" src="https://github.com/Edge-Computing-LLM/edge-llm-tests/actions/workflows/validate.yaml/badge.svg?branch=main"></a>
</p>

Expand All @@ -49,7 +49,7 @@ flowchart LR
CLI --> L2[llm-observability-stack<br/>Layer 2]
L1 --> K[(Ubuntu + k3s<br/>NVIDIA runtime)]
L2 --> A[(Ollama + WebUI<br/>telemetry + dashboards)]
K --> Q[qwen-gguf-observability<br/>runtime evidence]
K --> Q[gguf-observability<br/>multi-model runtime evidence]
A --> Q
CLI --> T[edge-llm-tests<br/>validation evidence]
L1 --> T
Expand All @@ -62,7 +62,7 @@ flowchart LR
| 🧭 [`edge-cli`](https://github.com/Edge-Computing-LLM/edge-cli) | Unified install, validation, status, logs, and safe uninstall workflows | Platform operators |
| ⚙️ [`k3s-nvidia-edge`](https://github.com/Edge-Computing-LLM/k3s-nvidia-edge) | Ubuntu, k3s, containerd NVIDIA runtime, GPU Operator, device plugin, and DCGM substrate | Infrastructure contributors |
| 📈 [`llm-observability-stack`](https://github.com/Edge-Computing-LLM/llm-observability-stack) | Ollama/GGUF, Open WebUI, OpenTelemetry, Prometheus, Grafana, alerts, benchmarks, and Helm profiles | LLMOps and observability contributors |
| 🔎 [`qwen-gguf-observability`](https://github.com/Edge-Computing-LLM/qwen-gguf-observability) | Dependency-free, read-only Qwen runtime contracts and privacy-safe evidence | Runtime verification |
| 🔎 [`gguf-observability`](https://github.com/Edge-Computing-LLM/gguf-observability) | Dependency-free, read-only contracts and privacy-safe evidence for Qwen, Gemma, Llama, and future GGUF models | Runtime verification |
| 🧪 [`edge-llm-tests`](https://github.com/Edge-Computing-LLM/edge-llm-tests) | Cross-repository Go/Git/Helm tests plus sanitized Ubuntu, k3s, NVIDIA, and inference results | Quality and reproducibility |

## Explore by goal
Expand All @@ -72,7 +72,7 @@ flowchart LR
| Install or operate the complete platform | [`edge-cli`](https://github.com/Edge-Computing-LLM/edge-cli#readme) | One control plane orders infrastructure and observability workflows. |
| Prepare Ubuntu, k3s, and an NVIDIA GPU | [`k3s-nvidia-edge`](https://github.com/Edge-Computing-LLM/k3s-nvidia-edge#readme) | Layer 1 owns host and Kubernetes accelerator readiness. |
| Deploy local inference and telemetry | [`llm-observability-stack`](https://github.com/Edge-Computing-LLM/llm-observability-stack#readme) | Layer 2 owns Ollama, WebUI, OpenTelemetry, metrics, dashboards, and profiles. |
| Verify the deployed Qwen contract | [`qwen-gguf-observability`](https://github.com/Edge-Computing-LLM/qwen-gguf-observability#readme) | Read-only checks capture privacy-safe runtime evidence. |
| Verify a deployed GGUF model contract | [`gguf-observability`](https://github.com/Edge-Computing-LLM/gguf-observability#readme) | Model-selectable, read-only checks capture privacy-safe runtime evidence. |
| Reproduce cross-project quality checks | [`edge-llm-tests`](https://github.com/Edge-Computing-LLM/edge-llm-tests#readme) | One Go harness records source, chart, cluster, GPU, and smoke-test results. |

## What makes this stack different
Expand All @@ -92,23 +92,24 @@ flowchart LR
## Reference edge path

The project family is exercised on Ubuntu 24.04 with k3s and an NVIDIA GeForce
940M, including a Qwen 1.8B Chat Q4_K_M GGUF profile. This proves that useful
private inference and observability can fit into a 1 GiB VRAM envelope; it is a
constrained-edge reference, not a claim of fleet-scale production capacity.
940M using low-memory Qwen 1.8B, Gemma 3 1B, and Llama 3.2 1B profiles. Models
run sequentially with partial CUDA layer offload, system-RAM fallback, and a
900 MiB observed VRAM ceiling. This is a constrained-edge reference, not a
claim of fleet-scale production capacity.

```text
Ubuntu host
└── k3s + containerd
├── NVIDIA runtime + GPU resource
├── Ollama + Qwen GGUF
├── Ollama + selectable Qwen, Gemma, or Llama GGUF model
├── Open WebUI
└── OpenTelemetry → Prometheus → Grafana
```

Point-in-time claims belong in versioned evidence, not marketing copy. Browse
[`edge-llm-tests`](https://github.com/Edge-Computing-LLM/edge-llm-tests) for the
cross-project matrix and
[`qwen-gguf-observability`](https://github.com/Edge-Computing-LLM/qwen-gguf-observability)
[`gguf-observability`](https://github.com/Edge-Computing-LLM/gguf-observability)
for the model-runtime contract.

## Get started
Expand Down