summaryrefslogtreecommitdiff
path: root/content/fetchers
Commit message (Collapse)AuthorAgeFilesLines
* Improve error reporting, and reflow to 80 columns.John Mark Bell2010-09-131-35/+67
| | | | svn path=/trunk/netsurf/; revision=10768
* Ensure the file that is read for info is in the platform's native path ↵Chris Young2010-09-121-9/+12
| | | | | | | | format, whilst the path used for any links is in the correct URL format. svn path=/trunk/netsurf/; revision=10761
* hell with it, heres a version which should result in fewer portability ↵Vincent Sanders2010-09-111-49/+27
| | | | | | complaints svn path=/trunk/netsurf/; revision=10756
* Merge branches/vince/netsurf-file-fetcher to trunkJohn Mark Bell2010-09-093-59/+650
| | | | | | r=jmb svn path=/trunk/netsurf/; revision=10750
* Don't suppress curl debug output, eitherJohn Mark Bell2010-07-171-2/+5
| | | | svn path=/trunk/netsurf/; revision=10651
* remove _GNU_SOURCE define from everywhere.Vincent Sanders2010-04-241-2/+0
| | | | | | strndup is not standard so provide an implementation. svn path=/trunk/netsurf/; revision=10474
* Purge spurious filetype computationJohn Mark Bell2010-04-181-1/+0
| | | | svn path=/trunk/netsurf/; revision=10431
* Fix mismatched free callJohn Mark Bell2010-04-171-1/+1
| | | | svn path=/trunk/netsurf/; revision=10420
* Fix file: handling on risc os, gtk, windows and framebuffer frontendsVincent Sanders2010-04-161-3/+2
| | | | svn path=/trunk/netsurf/; revision=10419
* Improve const-correctness of fetch_startJohn Mark Bell2010-04-102-5/+5
| | | | svn path=/trunk/netsurf/; revision=10342
* Purge FETCH_TYPE which is unused throughout NetSurf. Clearing a todo in ↵Daniel Silverstone2010-04-081-2/+2
| | | | | | llcachec. svn path=/trunk/netsurf/; revision=10300
* Fix fetch_curl_post_convert() for filename_from_path() returning NULL.Michael Drake2010-04-071-0/+3
| | | | svn path=/trunk/netsurf/; revision=10265
* rationalise the usage of the file schemeVincent Sanders2010-03-311-4/+5
| | | | svn path=/trunk/netsurf/; revision=10221
* Merge jmb/new-cache; r=dsilvers,rs=vinceDaniel Silverstone2010-03-282-67/+75
| | | | svn path=/trunk/netsurf/; revision=10180
* Move code which extracts the filename from a given path into frontend.Chris Young2010-03-211-32/+3
| | | | svn path=/trunk/netsurf/; revision=10139
* Rate limit fetch progress notifications.John Mark Bell2010-02-101-1/+14
| | | | svn path=/trunk/netsurf/; revision=9962
* remove uneccissary includesVincent Sanders2010-01-292-5/+3
| | | | svn path=/trunk/netsurf/; revision=9931
* Don't set proxy option for file: URLs to workaround some versions of libcurl ↵James Bursa2009-12-251-1/+4
| | | | | | attempting to use it (fixed in latest libcurl). Also unset curl proxy option if it's disabled so the previous xfer's setting isn't retained. svn path=/trunk/netsurf/; revision=9759
* Merge branches/MarkieB/gtkmain to trunk.John Mark Bell2009-12-172-28/+50
| | | | svn path=/trunk/netsurf/; revision=9729
* - content/urldb.c(auth_data): Removed;John Tytgat2009-08-041-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (prot_space_data): Added, it lives linked in the leaf host_part struct and together with its scheme and port (which defins canonical root url) and realm this defines a protection space. (path_data): Removed auth_data field and replaced by a prot_space_data pointer. (host_part::prot_space): Added linked list of protection space data structs. (urldb_get_auth_details): Given an URL fetch fetches its auth. (urldb_set_auth_details): Creates or updates the contents of a protection space to which given URL belongs. (urldb_destroy_host_tree): Delete protection data space structures using urldb_destroy_prot_space. (urldb_destroy_prot_space): Added. - content/urldb.h(urldb_get_auth_details): Added realm parameter. - content/fetchers/fetch_curl.c(fetch_curl_set_options): Update urldb_get_auth_details call (we don't know realm at this point). - content/fetchcache.c(fetchcache_callback, fetchcache_auth): At FETCH_AUTH, use realm to determine if we really don't know auth data and if so, refetch content. - content/content.h(struct content): Add content::tried_with_auth. - content/content.c(content_create): Initialize content::tried_with_auth. - riscos/401login.c(ro_gui_401login_open): Show known authentication data in dialogue so user can see what was wrong with it and correct it. Solves bug #2830829. svn path=/trunk/netsurf/; revision=9045
* Limit scope of manually-defined NDEBUG. Purge a bunch of redundant #undef ↵John Mark Bell2009-05-281-1/+0
| | | | | | NDEBUG. svn path=/trunk/netsurf/; revision=7593
* s/abort/abort_fetch/John Mark Bell2009-05-141-7/+7
| | | | svn path=/trunk/netsurf/; revision=7512
* Purge WITH_AUTHJohn Mark Bell2009-02-221-8/+1
| | | | svn path=/trunk/netsurf/; revision=6600
* Purge NETSURF_USE_SSL and WITH_SSLJohn Mark Bell2009-02-221-34/+0
| | | | svn path=/trunk/netsurf/; revision=6599
* Log detected state of openssl availabilityJohn Mark Bell2009-02-211-0/+2
| | | | svn path=/trunk/netsurf/; revision=6595
* Given that the build-time SSL detection can be somewhat inaccurate, attempt ↵John Mark Bell2009-02-211-4/+21
| | | | | | to determine whether we can use the SSL_CTX stuff at runtime. svn path=/trunk/netsurf/; revision=6586
* Squash strict-aliasing warning in the most disgusting way possible.John Mark Bell2009-01-151-1/+1
| | | | svn path=/trunk/netsurf/; revision=6070
* Silence a bunch of warnings caused by cURL's typecheck-gcc stuff being ↵Daniel Silverstone2009-01-081-28/+41
| | | | | | strict and in one case cURL simply being daft (whoever heard of a signed HTTP response code?). svn path=/trunk/netsurf/; revision=5991
* Better, safer fix for the type punning issueDaniel Silverstone2008-10-131-6/+5
| | | | svn path=/trunk/netsurf/; revision=5562
* Fix type-punning warning in fetch_data.cDaniel Silverstone2008-10-131-1/+5
| | | | svn path=/trunk/netsurf/; revision=5561
* Add additional debug to fetch errors from cURLDaniel Silverstone2008-08-221-2/+4
| | | | svn path=/trunk/netsurf/; revision=5174
* First round of C89 fixes. Those should be obvious, hope I didn't introduce ↵François Revel2008-07-291-1/+1
| | | | | | any side effect. svn path=/trunk/netsurf/; revision=4788
* Handle errors returned by curl_multi_perform(), such as out of memory, ↵James Bursa2008-06-141-2/+7
| | | | | | instead of exiting. svn path=/trunk/netsurf/; revision=4329
* Stop processing headers and sending FETCH_HEADER if fetch was aborted.James Bursa2008-05-311-0/+5
| | | | svn path=/trunk/netsurf/; revision=4231
* Fix handling of cache control dataJohn Mark Bell2008-05-301-5/+6
| | | | svn path=/trunk/netsurf/; revision=4227
* Add new fetch callback FETCH_HEADER for headers and move as much header ↵James Bursa2008-05-301-104/+11
| | | | | | parsing as possible from fetch_curl.c to fetchcache.c. This simplifies fetch_curl.c and will make it possible to store response headers in future. svn path=/trunk/netsurf/; revision=4226
* - introduction of SLEN()John Tytgat2008-05-251-1/+1
| | | | | | | - enforce result of url_normalize() being NULL on failure - plug memory leak when url_normalize() fails svn path=/trunk/netsurf/; revision=4200
* No longer suppress the default Accept: header.John Mark Bell2008-05-241-1/+0
| | | | | | | This fixes all those sites that brokenly assume that it's required and thus break when the client doesn't send one (here's looking at you royalmail.com). libcurl's default Accept header is "*/*", which is semantically equivalent to not sending a header at all (no header implies the client accepts all content types). svn path=/trunk/netsurf/; revision=4196
* Remove unnecessary includesJohn Mark Bell2008-05-111-3/+0
| | | | svn path=/trunk/netsurf/; revision=4144
* Squash warningJohn Mark Bell2008-03-191-1/+1
| | | | svn path=/trunk/netsurf/; revision=3983
* jmb's rework of data: URL handlingRob Kendrick2008-03-061-36/+78
| | | | svn path=/trunk/netsurf/; revision=3890
* Add another check for malformed data: URLsRob Kendrick2008-03-051-1/+10
| | | | svn path=/trunk/netsurf/; revision=3889
* Many data: fixes. Acid2 no longer crashes NetSurf.Rob Kendrick2008-03-051-44/+84
| | | | svn path=/trunk/netsurf/; revision=3888
* Check for calloc() failingRob Kendrick2008-03-051-0/+3
| | | | svn path=/trunk/netsurf/; revision=3885
* Use curl_free() when freeing data: URLs that are URL-encoded instead of ↵Rob Kendrick2008-03-051-1/+4
| | | | | | using free() svn path=/trunk/netsurf/; revision=3884
* Initial attempt at implementing data: URLs. Needs cleaning and verifying ↵Rob Kendrick2008-03-052-0/+239
| | | | | | that I'm using the fetcher API correctly. Appears to work, though. svn path=/trunk/netsurf/; revision=3882
* Make core fetching code handle verifiability of transactionsJohn Mark Bell2008-01-301-22/+3
| | | | | | | | Make core fetching code be responsible for inserting cookies into the urldb Provide accessor to a fetch's parent url (this is defined as being the URL of the verifiable fetch which caused this one to occur) Make fetchcache's 3xx handling use the parent url when spawning new fetches svn path=/trunk/netsurf/; revision=3809
* Update all source code file headers to reflect GPL version 2 only and ↵Vincent Sanders2007-08-082-7/+28
| | | | | | contain appropriate licence text svn path=/trunk/netsurf/; revision=3486
* Ensure option strings aren't blank before setting headers: previously, a ↵John Mark Bell2007-07-211-2/+2
| | | | | | blank option string could result in "Accept-Language: , *;q=0.1" being sent, for example. svn path=/trunk/netsurf/; revision=3450
* Fix deadlock when fetching stylesheets when max_fetchers_per_host is reached ↵James Bursa2007-07-041-3/+6
| | | | | | by splitting fetch_can_be_freed() into fetch_remove_from_queues() and fetch_free(). svn path=/trunk/netsurf/; revision=3380