mirror of
https://github.com/dogkeeper886/ollama37.git
synced 2025-12-10 07:46:59 +00:00
8dc4ca7ccc
- Restructure from ollama37/ to docker/ with clear separation
- Separate builder and runtime images into dedicated directories
- Group environment scripts in builder/scripts/ subdirectory
- Add comprehensive root-level README.md (257 lines)
- Add .dockerignore files for optimized build contexts
- Enhance shell scripts with shebangs and documentation headers
- Update docker-compose.yml to build locally instead of pulling
- Add environment variables for GPU and host configuration
- Remove duplicate Dockerfile and confusing nested structure
New structure:
docker/
├── README.md (comprehensive documentation)
├── docker-compose.yml (local build support)
├── builder/ (build environment: CUDA 11.4 + GCC 10 + Go 1.24)
│ ├── Dockerfile
│ ├── README.md
│ ├── .dockerignore
│ └── scripts/ (organized environment setup)
└── runtime/ (production image)
├── Dockerfile
├── README.md
└── .dockerignore
This reorganization eliminates confusion, removes duplication, and
provides a professional, maintainable structure for Tesla K80 builds.
50 lines
3.0 KiB
Markdown
50 lines
3.0 KiB
Markdown
# Ollama CUDA 11.4 Builder Image for Tesla K80 (Compute Capability 3.7)
|
|
|
|
This Docker image provides a development environment tailored specifically to build [Ollama37](https://github.com/dogkeeper886/ollama37) on older NVIDIA GPUs, with an emphasis on devices like the **Tesla K80** which have compute capability of `3.7`. It comes equipped with essential tools and software including CUDA toolkit 11.4 support.
|
|
|
|
## 🔧 Key Features
|
|
|
|
- **Base Image:** Rocky Linux v8
|
|
- **CUDA Toolkit Version:** 11.4 - For high-performance GPU acceleration.
|
|
- **NVIDIA Driver (v470):** `nvidia-driver:470-dkms` to ensure compatibility with Tesla K80 GPUs and beyond, specifically targeting compute capability of version 3.7.
|
|
- **GCC v10:** A versatile compiler that will be necessary for building C/C++ projects in this Docker image environment is compiled from source within the container itself; thus ensuring up-to-date features are available during builds.
|
|
- **CMake (v4.0.0):** This build system generator, also built directly into our custom Rocky Linux 8 image version v10 ensures a comprehensive and flexible C/C++ project building process that can be tailored to your needs within this environment; again compiled from source for the latest features right in your container.
|
|
- **Go (v1.24.2):** This lightweight programming language is essential when compiling Go projects, especially those utilizing cgo.
|
|
|
|
This Docker image strikes a balance between supporting legacy hardware such as Tesla K80 and meeting modern software build requirements like CUDA 11.4 for cutting-edge development needs including but not limited to Ollama37.
|
|
|
|
|
|
## 🚀 How To Use
|
|
|
|
Designed with builders in mind; this container is perfect when you're aiming to compile projects that leverage the power of NVIDIA GPUs, particularly those compatible with compute capability `3.7`.
|
|
|
|
### Quick Example Usage:
|
|
|
|
```docker
|
|
docker run --rm -it dogkeeper886/ollama37-builder bash
|
|
```
|
|
|
|
When you have access inside your newly instantiated Docker environment (`dogkeeper886/ollama37-builder`):
|
|
|
|
1. Navigate to the source directory:
|
|
```bash
|
|
cd /usr/local/src \
|
|
&& git clone https://github.com/dogkeeper886/ollama37 \
|
|
&& cd ollama37
|
|
```
|
|
2. Set up your build and compile it using CMake along with GCC (as our custom compiled version):
|
|
```bash
|
|
CC=/usr/local/bin/gcc CXX=/usr/local/bin/g++ cmake -B build \
|
|
&& cmake --build build
|
|
```
|
|
3. Lastly, go ahead and compile the project using Go (also utilizing our custom-built version), ensuring you have enabled modules for compatibility:
|
|
```bash
|
|
go build -o ollama .
|
|
```
|
|
|
|
## 🎯 Contributing
|
|
|
|
We're thrilled to welcome your contributions! Should you encounter any issues or have ideas for improving this Docker image, please submit them as an issue on the GitHub repository: [https://github.com/dogkeeper886/ollama-k80-lab](https://github.com/dogkeeper886/ollama-k80-lab).
|
|
|
|
We are committed to continually enhancing our projects and appreciate all feedback. Thank you!
|