HTTP and keep-alive

Dev Community Dev/API Corner
1

I found a website today that refuses a HTTP GET(return code 503 - Service Unavailable) when using:

pageElement = HTML.ElementFromURL('http://roosterteeth.com/archive/series.php')

 

The page is loadable via Safari and I tried to add all Headers that Safari is outputting but the same error occurs.

 

The only Header parameter I couldn't set(for obvious reasons) was the Connection parameter so I'm suspecting that this is the reason why it fails.

 

So, my question:

- Is there a framework function that supports keep-alive connections?

 

Regards

2

Hi!

It looks like the problem with this site is not with headers, but with some form of protection they now use. The first page that loads (that's given the 503) automatically fills in a form with calculated values (all done in javascript). This form is posted, cookies are set and then the page is loaded again with the real content.

3

Hi!

It looks like the problem with this site is not with headers, but with some form of protection they now use. The first page that loads (that's given the 503) automatically fills in a form with calculated values (all done in javascript). This form is posted, cookies are set and then the page is loaded again with the real content.

Thanks, I totally missed that!

Now when logging while requesting the same page in Chrome, I see a totally different "handshake". Will look into it ...

Another question:

- If the cookies are used for authentication, where would the best place to add code for this in the plugin, in the Start routine perhaps?

4

I've managed to sort out the problem, but hey what a hack it became!  :)

5

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.