Invalid URL translation. #34

macdabby · 2017-11-15T13:32:15Z

I just started seeing this when updating to vagrant 2.0.1 and virtualbox 5.2.x, however I still see it now when I downgrade to vagrant 1.9.1 and virtualbox 5.1.x

vagrant-s3auth is v1.3.2

In the vagrant file I have defined

config.vm.box = "boxnamae"
config.vm.box_url = "s3://path/to/box"
REGION = "us-east-1"

I get the following output:

==> default: Checking if box 'boxname' is up to date...
The metadata for the box was malformed. The exact error
is shown below. Please contact the maintainer of the box so
that this issue can be fixed.

751: unexpected token at '<html><head><meta http-equiv="refresh" content="0;url=http://lookup.t-mobile.com/index.php?origURL=http://s3-placeholder.amazonaws.com/path/to/box&bc="/></head><body><script type="text/javascript">window.location="http://lookup.t-mobile.com/index.php?origURL="+escape(window.location)+"&r="+escape(document.referrer)+"&bc=";</script></body></html>'

My ISP is tmobile and this is their default response for requesting a page where the DNS can't be found. Notice that it's trying to access http://s3-placeholder.amazonaws.com/path/to/box with the domain s3-placeholder.... I believe that should be something like us-east-1.amazonaws.com or something like that. I looked in the source for this plugin but i wasn't able to understand where it replaces this placeholder.

The text was updated successfully, but these errors were encountered:

benesch · 2017-11-16T03:53:01Z

That placeholder URL will get picked up by the S3_HOST_MATCHER:

vagrant-s3auth/lib/vagrant-s3auth/util.rb

Lines 47 to 51 in fb112e9

    
           elsif match = S3_HOST_MATCHER.match(url.host) 
        
             components = url.path.split('/').delete_if(&:empty?) 
        
             bucket = match['bucket'] || components.shift 
        
             key = components.join('/') 
        
           end

At least, it will in theory. I'll look into this.

macdabby · 2017-11-16T12:50:42Z

Interesting, I was just able to test this on another network. On Network A (tmobile) nonexistingdomain.com returns a DNS entry for Network A's search/notfound page with HTTP code 200. On network B, DNS returns no entries. On network B, I do not get the error mentioned, and the box starts up just fine.

So it seems like maybe this is what's happening:

Vagrant attempts to load http://s3-placeholder.amazonaws.com/path/to/box
Only if that fails, the URL is reprocessed in the S3_HOST_MATCHER mentioned above to the correct URL.
If the s3-placeholder.amazonaws.com URL returns a 200 with content, vagrant attempts to parse this content as the expected response.

Additional note: This had nothing to do with the upgrade, that was just coincidence.

benesch · 2017-11-16T14:45:30Z

Ah, yes, that theory sounds exactly right! vagrant-s3auth tries to be a good citizen by letting Vagrant attempt to download the box first. If and only if the download of that box fails does vagrant-s3auth kick in. We look for failures at the HTTP layer, though, so TMobile's garbage looks like valid box metadata until a higher layer of Vagrant actually tries to parse it as JSON.

I'm struggling to remember why I switched from "http://s3.amazonaws.com" to "http://s3-placeholder.amazonaws.com", and the commit message, er, is less than helpful (ee6086b). I'll have some time tomorrow to dig in.

paul-court · 2018-06-22T10:42:42Z

+1

This also happens for virgin media customers in the UK. By default the network turns on one of those annoying search results pages. So http://s3-placeholder.amazonaws.com does indeed resolve. :-/

The final result is that a chunk of html gets downloaded and vagrant fails to untar it with a message like this:-

Bringing machine 'default' up with 'virtualbox' provider...
==> default: Box 'propertyfile/standard_1404' could not be found. Attempting to find and install...
    default: Box Provider: virtualbox
    default: Box Version: >= 0
==> default: Box file was not detected as metadata. Adding it directly...
==> default: Adding box 'propertyfile/standard_1404' (v0) for provider: virtualbox
    default: Downloading: s3://1psg-infrastructure/PropertyFile/vagrant/1404/standard.json
    default: Signing S3 request with key '<REDACTED>' loaded from profile '1psgdev'
The box failed to unpackage properly. Please verify that the box
file you're trying to add is not corrupted and that enough disk space
is available and then try again.
The output from attempting to unpackage (if any):

bsdtar: Error opening archive: Unrecognized archive format

boneill42 · 2018-07-16T16:10:09Z

What's the status on this one? (i'm +1 as well)

chrisemerson · 2021-01-03T23:00:45Z

I am also now seeing this, again because of the Virgin Media search page (which won't turn off despite me trying to turn it off). Any update on this please?

chrisemerson · 2021-01-03T23:04:41Z

Annoyingly it looks a lot like this project has been abandoned :/

benesch · 2021-01-04T04:30:32Z

Annoyingly it looks a lot like this project has been abandoned :/

Indeed. I haven't been employed by @WhoopInc in six years, and I doubt they're even still using this plugin. CI broke constantly due to constant Travis CI, Vagrant, and AWS changes, which were too exhausting for me to keep up with in my free time.

If you'd like to submit a PR, I'd be delighted to take a look provided you can get it to pass tests. See my comment here: #39 (comment).

chrisemerson · 2021-01-04T10:38:44Z

Annoyingly it looks a lot like this project has been abandoned :/

Indeed. I haven't been employed by @WhoopInc in six years, and I doubt they're even still using this plugin. CI broke constantly due to constant Travis CI, Vagrant, and AWS changes, which were too exhausting for me to keep up with in my free time.

If you'd like to submit a PR, I'd be delighted to take a look provided you can get it to pass tests. See my comment here: #39 (comment).

I would love to but I don't know any Ruby at all unfortunately :( I've fixed this for now on Virgin Media by switching to google's DNS service.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Invalid URL translation. #34

Invalid URL translation. #34

macdabby commented Nov 15, 2017 •

edited

Loading

benesch commented Nov 16, 2017

macdabby commented Nov 16, 2017 •

edited

Loading

benesch commented Nov 16, 2017

paul-court commented Jun 22, 2018 •

edited

Loading

boneill42 commented Jul 16, 2018

chrisemerson commented Jan 3, 2021

chrisemerson commented Jan 3, 2021

benesch commented Jan 4, 2021

chrisemerson commented Jan 4, 2021

Invalid URL translation. #34

Invalid URL translation. #34

Comments

macdabby commented Nov 15, 2017 • edited Loading

benesch commented Nov 16, 2017

macdabby commented Nov 16, 2017 • edited Loading

benesch commented Nov 16, 2017

paul-court commented Jun 22, 2018 • edited Loading

boneill42 commented Jul 16, 2018

chrisemerson commented Jan 3, 2021

chrisemerson commented Jan 3, 2021

benesch commented Jan 4, 2021

chrisemerson commented Jan 4, 2021

macdabby commented Nov 15, 2017 •

edited

Loading

macdabby commented Nov 16, 2017 •

edited

Loading

paul-court commented Jun 22, 2018 •

edited

Loading