Part 3: Adding dependencies With Caching

Search…
To copy the files for this example ( Part 3 ) run
1
earthly --artifact github.com/earthly/earthly/examples/tutorial/go:main+part3/part3 ./part3
Copied!
Examples in Python, Javascript and Java are at the bottom of this page.
Dependencies
Now let's imagine that we want to add some dependencies to our app. In Go, that means adding go.mod and go.sum.
./go.mod
1
module github.com/earthly/earthly/examples/go
2
​
3
go 1.13
4
​
5
require github.com/sirupsen/logrus v1.5.0
Copied!
./go.sum (empty)
1
​
Copied!
The code of the app might look like this
./main.go
1
package main
2
​
3
import "github.com/sirupsen/logrus"
4
​
5
func main() {
6
	logrus.Info("hello world")
7
}
Copied!
Now we can update our Earthfile to copy in the go.mod and go.sum.
./Earthfile
1
VERSION 0.6
2
FROM golang:1.15-alpine3.13
3
WORKDIR /go-example
4
​
5
build:
6
    COPY go.mod go.sum .
7
    COPY main.go .
8
    RUN go build -o build/go-example main.go
9
    SAVE ARTIFACT build/go-example /go-example AS LOCAL build/go-example
10
​
11
docker:
12
    COPY +build/go-example .
13
    ENTRYPOINT ["/go-example/go-example"]
14
    SAVE IMAGE go-example:latest
Copied!
This works, but it is inefficient because we have not made proper use of caching. In the current setup, when a file changes, the corresponding COPY command is re-executed without cache, causing all commands after it to also re-execute without cache.
Caching
If, however, we could first download the dependencies and only afterwards copy and build the code, then the cache would be reused every time we changed the code.
./Earthfile
1
VERSION 0.6
2
FROM golang:1.15-alpine3.13
3
WORKDIR /go-example
4
​
5
build:
6
    # Download deps before copying code.
7
    COPY go.mod go.sum .
8
    RUN go mod download
9
    # Copy and build code.
10
    COPY main.go .
11
    RUN go build -o build/go-example main.go
12
    SAVE ARTIFACT build/go-example /go-example AS LOCAL build/go-example
13
​
14
docker:
15
    COPY +build/go-example .
16
    ENTRYPOINT ["/go-example/go-example"]
17
    SAVE IMAGE go-example:latest
Copied!
For a primer into Dockerfile layer caching see this article. The same principles apply to Earthfiles.
Reusing Dependencies
In some cases, the dependencies might be used in more than one build target. For this use case, we might want to separate dependency downloading and reuse it. For this reason, let's consider breaking this out into a separate target called +deps. We can then inherit from +deps by using the command FROM +deps.
./Earthfile
1
VERSION 0.6
2
FROM golang:1.15-alpine3.13
3
WORKDIR /go-example
4
​
5
deps:
6
    COPY go.mod go.sum ./
7
    RUN go mod download
8
    # Output these back in case go mod download changes them.
9
    SAVE ARTIFACT go.mod AS LOCAL go.mod
10
    SAVE ARTIFACT go.sum AS LOCAL go.sum
11
​
12
build:
13
    FROM +deps
14
    COPY main.go .
15
    RUN go build -o build/go-example main.go
16
    SAVE ARTIFACT build/go-example /go-example AS LOCAL build/go-example
17
​
18
docker:
19
    COPY +build/go-example .
20
    ENTRYPOINT ["/go-example/go-example"]
21
    SAVE IMAGE go-example:latest
Copied!
More Examples
Javascript
Java
Python
Part 2: Outputs
Part 4: Args
Last modified 1mo ago
Copy link
Contents
Dependencies
Reusing Dependencies
More Examples