Using CDN to host EE packages

[rahul286]

I often see some users fail to install some packages because of network issues.

I am planning to add a CDN from where we can distribute packages/files needed during EE setup.

But as EE installs too many things, I am finding it hard to judge which stuff we need to host on CDN.

[MiteshShah]

I often see some users fail to install some packages because of network issues.

I see lots of issue when users are not able to install packages and the reason for this issue is not network connectivity but GPG keys not fetch properly.

In EE 2.X we created safe guard for this issue
Refer: https://github.com/rtCamp/easyengine/blob/old-stable/config/easyengine/ee.conf#L5
https://github.com/rtCamp/easyengine/blob/old-stable/src/lib/ee_lib_gpg_key_fix.sh

@gau1991 @harshadyeola in EE 3.x we have this feature ?

[rahul286]

I see lots of issue when users are not able to install packages and the reason for this issue is not network connectivity but GPG keys not fetch properly.

What are common reasons for GPG keys not getting fetched?

Can we retry like 5 times?

Or cache keys on a CDN. May be have a cron job fetching keys and saving on a CDN location. (Not sure if this is allowed in terms of security)

[MiteshShah]

What are common reasons for GPG keys not getting fetched?

Unable to contact server in default timeout, Server is not responding.

Can we retry like 5 times?

Yup we need to run following code 5 times with different keyservers.

        # Fix GnuPG key problems
        apt-get update > /dev/null 2> /tmp/gpg_key

        for ee_gpg_key_check in $(grep "NO_PUBKEY" /tmp/gpg_key |sed "s/.*NO_PUBKEY //")
        do
            ee_lib_echo "Processing GnuPG key: $ee_gpg_key_check"
            gpg --keyserver subkeys.pgp.net --recv $ee_gpg_key_check &>> $EE_COMMAND_LOG \
            && gpg --export --armor $ee_gpg_key_check \
            | apt-key add - &>> $EE_COMMAND_LOG
        done

[rahul286]

Update: v4 will be using docker images for all packages it needs. So this issue is no longer relevant.