kitchen speed

[juju4]

Just a remark, inside travis,

• docker role execution takes a bit less than 2min
  https://travis-ci.org/juju4/ansible-adduser/builds/159124581
• kitchen converge (with no roles bug) and verify (idempotence and serverspec) takes 3.30 to 4.30 min
  https://travis-ci.org/juju4/ansible-adduser/builds/159121071
• lxd alone 3 to 4min (role execution and serverspec)
  https://travis-ci.org/juju4/ansible-adduser/builds/159116620
• simple trusty only execution (execution, idempotence) ~1.07min
  https://travis-ci.org/juju4/ansible-adduser/builds/159127352

any idea what can be tuned?

As sidenote, lxd on travis is heavily network bound as we download images...

[bradenwright]

So I'll try to speak more to this/look into it, but figured I'd reply right away with what I know.

1. Waiting for SSH to become ready seems to be a bottleneck, if I/someone were to write an transport in lxd (vs using ssh) then it would speed up. enable_wait_for_ssh_login: false is default I believe, if its false then it speeds up ssh, but not relying on ssh would be nice.

2. When you say network bound, I did build in/have used polipo to setup a proxy, that way you only have to wait first time it downloads (not sure if docker is doing any caching)

3. Serverspec gem(s) install(s) are slow, I believe there was a bug which may or may not have been fixed were it installed everytime. https://github.com/bradenwright/kitchen-lxd_cli#verifier_path talks detail, you can try that. Or inspec works a lot faster and I've been using that, to get inspec to work I set

transport:
  name: sftp
  ssh_key: ~/.ssh/id_rsa

verifier:
  name: inspec

I'll look into it further/discuss with you more I just wanted to throw out a few things right away.

[bradenwright]

^^^ FYI I will look these further... especially (3) I know that rewrite your tests is not ideal.

[bradenwright]

FYI for (1) you maybe able to set docker to use the sftp transport, that may give you info on how much the speed is bound by the transport. But when you have a min let me know what you mean by you think its network bound downloading images.

Also do you know if lxd images are bigger than docker images? Is that part of the issue/factor.

[juju4]

On 1, there is an easy alternative
https://github.com/juju4/ansible-lxc-ssh
it's a fork with support of lxd/lxc2 (basic s/lxc-attach --name/lxc exec/)
so you have a transport config_option after it needs to be adapted for kitchen

On 2, yes locally, it's manageable with proxy but for test run inside travis, nothing I can do except asking them to add mirror

For 3, I'm also using inspec but for different usage, more security audit than infra testing. I also played with ansiblespec which maps ansible inventory and roles from playbook file. Not reviewed speed for now.

In both cases, the thing which annoys me is all packages kitchen download/install itself, part not used when using ansible.

Current lxc images I have

$ lxc image list
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
|         ALIAS         | FINGERPRINT  | PUBLIC |                  DESCRIPTION                  |  ARCH  |   SIZE   |          UPLOAD DATE          |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| alpine-3.4            | aa414120f1bc | no     |                                               | x86_64 | 21.71MB  | Aug 25, 2016 at 1:47am (UTC)  |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| alpine-3.4-nossh      | 5fae56e123cb | no     | Alpine 3.4 (amd64) (20160824_17:50)           | x86_64 | 2.63MB   | Aug 25, 2016 at 12:56am (UTC) |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| centos-6              | a59ca6b2c890 | no     |                                               | x86_64 | 129.94MB | Aug 25, 2016 at 12:08am (UTC) |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| centos-6-nossh        | 18c20e19cd84 | no     | Centos 6 (amd64) (20160814_02:16)             | x86_64 | 65.78MB  | Aug 14, 2016 at 3:10pm (UTC)  |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| centos-7              | a01e15be277c | no     |                                               | x86_64 | 151.96MB | Aug 14, 2016 at 3:15pm (UTC)  |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| centos-7-nossh        | 6ea75c01ccac | no     | Centos 7 (amd64) (20160814_02:16)             | x86_64 | 62.90MB  | Aug 14, 2016 at 3:10pm (UTC)  |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| ubuntu-12.04          | 38a72ae0da86 | no     | ubuntu 12.04 LTS amd64 (release) (20160808)   | x86_64 | 155.44MB | Aug 14, 2016 at 3:10pm (UTC)  |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| ubuntu-14.04          | 8f5108a99312 | no     | ubuntu 14.04 LTS amd64 (release) (20160809.1) | x86_64 | 119.36MB | Aug 14, 2016 at 3:06pm (UTC)  |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| ubuntu-16.04          | 6b01a4085ba9 | no     |                                               | x86_64 | 229.20MB | Aug 14, 2016 at 3:13pm (UTC)  |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+
| ubuntu-16.04-nopython | 199e9a37b6aa | no     | ubuntu 16.04 LTS amd64 (release) (20160721)   | x86_64 | 316.22MB | Aug 14, 2016 at 3:05pm (UTC)  |
+-----------------------+--------------+--------+-----------------------------------------------+--------+----------+-------------------------------+

As for docker size, I would expect to be in the same order. But it is more variable it seems
my docker images goes from 5MB (Alpine linux) to 1GB or so.
some analysis: http://developers.redhat.com/blog/2016/03/09/more-about-docker-images-size/
Surprisingly, did not find reference to a docker image mirror at travis.