Home / Rust / HTTP Client

http-types - Common types for HTTP operations

http-types Common types for HTTP operations. API Docs | Releases | Contributing Installation $ cargo add http-types Safety This crate uses unsafe in a
Information
Category: Rust / HTTP Client
Watchers: 13
Star: 176
Fork: 65
Last update: Jun 26, 2022
Resource links
https://docs.rs/http-types
https://github.com/http-rs/http-types

http-types

Common types for HTTP operations.

Installation

$ cargo add http-types

Safety

This crate uses unsafe in a few places to convert from validated ASCII byte buffers to utf-8 strings.

Contributing

Want to join us? Check out our "Contributing" guide and take a look at some of these issues:

License

Licensed under either of Apache License, Version 2.0 or MIT license at your option.
Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in this crate by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.
130 Open More issues
Closed

Add `proxies::Forwarded` header

~~Experimented a bit with a COW-like interface for the forwarded header. Let me know if you'd prefer to switch to just the Owned version. Alternatively, if y'all like this pattern, we might want to use it for other headers~~

~~edit: switching to draft — noticed some additional complexity in the spec that this version doesn't handle. Interested in feedback on the Cow-like interface, though~~

Ok! This pr now includes is now an efficient and correct hand-rolled parser for tokens and quoted strings as defined by https://tools.ietf.org/html/rfc7230#section-3.2.6, and for the Forwarded header, including a spec-conforming normalization from the x-forwarded-{for, proto, and by} headers. Hopefully the token and quoted-string parsers will be helpful for other header parsers in http-types

Ref #99

opened Aug 7, 2020 by jbr 11
Closed

Rename Body::from_file to Body::from_path, add Body::from_file, handle filename-based MIME-type guessing for File objects

This splits a Body::from_open_file out from Body::from_file so that users who want to use a file opened in a manner other than File::open can do so.

In particular, this will help users using cap_std::fs::Dir::open to open files without requiring http-types to have a dependency on cap_std.

semver-major 
opened Jan 15, 2021 by sunfishcode 10
Closed

Design proposal: Add some sort of `canceled` flag to Request

This would touch tide and possibly async-h1 as well. The idea proposed by @jdortiz in discord was for tide to support connection cancellation in order to early-return from the middleware-response handler stack

opened May 26, 2020 by jbr 9
Closed

Sniff mime types

Related to https://github.com/yoshuawuyts/http-types/issues/29, we currently assume all streams by default are octet streams. By using the MIME type sniffing algorithm we can do better and try and determine the mime type of a stream when it is first passed, if it hasn't been set already.

Impl

When a stream is passed as the body:

  • check whether a mime type has been set already
  • if no mime type has been set, peek at the first 4 bytes of the stream
  • determine the mime type using a crate such as infer
  • if no mime type matches, fall back to mime::BYTE_STREAM
  • set the Content-Encoding header accordingly
opened Dec 6, 2019 by yoshuawuyts 9
Closed

Change signature of insertion/appending of headers

Currently the insert and append functions on Headers panics on illegal header value encoding. This commit exposes that failure mode to the library users by wrapping the return in a result instead.

This change exposes a possible optimization in places where insert/append is called with values known to be safe by creating unsafe insertion/appending functions. This commit does not implement any such extensions.

Fixes #383

opened Oct 30, 2021 by halvko 8
Closed

Several missing MIME type extension detections

opened Nov 26, 2020 by richardanaya 8
Open

merge tide-compress's mime db stuff into the Content-Type typed header

basically, this but with the other fields that the json database provides: https://github.com/Fishrock123/tide-compress/blob/main/build.rs

see https://github.com/jshttp/mime-db/blob/master/db.json

enhancement HTTP Header 
opened Jun 21, 2022 by Fishrock123 1
Open

X-DNS-Prefetch-Control

null

enhancement HTTP Header 
opened Jun 17, 2022 by yoshuawuyts 0
Open

X-Frame-Options

null

enhancement HTTP Header 
opened Jun 17, 2022 by yoshuawuyts 0
Open

X-Content-Type-Options

null

enhancement HTTP Header 
opened Jun 17, 2022 by yoshuawuyts 0
Open

Want-Digest

null

enhancement HTTP Header 
opened Jun 17, 2022 by yoshuawuyts 0
Open

User-Agent

null

enhancement HTTP Header 
opened Jun 17, 2022 by yoshuawuyts 0

v2.12.0(Aug 10, 2021)

Additions:

  • AsRef<anyhow::Error> for http_types::Error
  • From<Vec<HeaderValue>> for HeaderValues
  • More TryFrom<> conversions for the "hyperium_http" feature.

Fixes:

  • Addressed three bugs in forwarded header parsing. https://github.com/http-rs/http-types/pull/375

Dependencies:

  • Update serde_qs to 0.8.3

v2.11.1(May 3, 2021)

http-types provides shared types for HTTP operations. It combines a performant, streaming interface with convenient methods for creating headers, urls, and other standard HTTP types. This is part of the http-rs project and powers the tide framework and surf client. Check out the docs or join us on Zulip.

Highlights

This release fixes an unconditional panic in the hyperium_http compatibility feature.

The http-types 3.0 merge window remains open, and you can see the nominated items for the next major version as part of the Semver-Major issue on GitHub.

Fixed

  • hyperium_http: Avoids unconditional panic when translating headers from hyperium. #359

v2.11.0(Apr 15, 2021)

http-types provides shared types for HTTP operations. It combines a performant, streaming interface with convenient methods for creating headers, urls, and other standard HTTP types. This is part of the http-rs project and powers the tide framework and surf client. Check out the docs or join us on Zulip.

Highlights

This release represents continued support of the http-types 2.x release line due to delays in the development of http-types 3.0.0. This release comes with several convenience features, listed below.

The http-types 3.0 merge window remains open, and you can see the nominated items for the next major version as part of the Semver-Major issue on GitHub.

Changed

  • Allowed Request.query() to deserialize into a borrowed Deserialize<'de> rather than just DeserializeOwned. #333

Added

  • More HTTP Methods from the IANA registry. #332
  • Body::chain() for merge multiple Body instances. #342, #346
  • AsRef<str> for Version, returning 'static str. #351
  • Error::from_debug(), a helper for converting from std::error::Errors. #345
  • Error::from_display, a helper for converting from std::error::Errors. #345

Fixed

  • Corrected error messages for Content-Encoding and Transfer-Encoding. #354

Docs

  • Improved request examples with the url's crate new TryFrom<&str>. #324
  • 4xx status codes now have the right descriptions. #341
  • Fixed for Content-Encoding and Transfer-Encoding docs. #354

v2.10.0(Jan 22, 2021)

http-types provides shared types for HTTP operations. It combines a performant, streaming interface with convenient methods for creating headers, urls, and other standard HTTP types. This is part of the http-rs project and powers the tide and surf frameworks. Check out the docs or join us on Zulip.

Highlights

This release introduces several new typed headers:

  • transfer::TransferEncoding: The form of encoding used to safely transfer the payload body to the user.
  • transfer::TE: Client header advertising the transfer encodings the user agent is willing to accept.
  • other::RetryAfter: Indicate how long the user agent should wait before making a follow-up request.
  • other::Referer: Contains the address of the page making the request.
  • content::Accept: Client header advertising which media types the client is able to understand.
  • content::ContentType: Indicate the media type of a resource's content.

Most notably is probably the RetryAfter header, which can be used to enable load-shedding on the client. An example of such a middleware has been authored for Tide.

http-types 3.0 merge window opened

This marks the final release of the 2.x release line of http-types. It's been almost a year since our last major release, and we've decided to open up the merge window for http-types 3.0 now that 2.10.0 has shipped. You can see the nominated items for the next major version as part of the Semver-Major issue on GitHub.

Because this is the first major release of http-types we're doing since we moved to our monthly release cadence, we're not entirely sure yet how we'll manage this. Perhaps next month's release may be a beta release. Or we may delay doing a release at all until all items have been merged. We'll have to see, but once 3.0 is out we'll resume the monthly release cadence.

Added

  • Add the Retry-After type header #314
  • Allow omitting cookie support, with a new "cookies" feature #306
  • Add Transfer-Encoding and TE headers #301
  • Add other::SourceMap header #278
  • Add other::Referer header #277
  • Add content::{Accept, ContentType} headers #270

Changed

  • Update examples to use TryFrom<str> for Url implementation #294

Internal

  • Fix clippy lints #321
  • Delete .travis.yml #312
  • Refactor media type internals #310
  • Make MIME tests conditional on the "fs" feature #307
  • Upgrade pin-project-lite to 0.2.0 #299

v2.9.0(Dec 4, 2020)

Features:

Internal:

  • Body Read implementation now will not read beyond the content-length, if one is provided. Previously this logic existed in async-h1, but now is the responsibility of Body #282

v2.8.0(Nov 13, 2020)

This patch adds support for cache::ClearSiteData, content::ContentLocation and implements ToHeaderValues for more string types. This continues our progress on implementing typed headers. We're currently at 50/70 implemented, and expect to be finishing up in the near future. At which point we can start to integrate these into higher-level crates such as tide and surf.

Added

  • Implement ToHeaderValues for more string types #279
  • Add cache::ClearSiteData header #265
  • Add content::ContentLocation header #256, #276

Internal

  • CI improvements #275

Contents

    devstark-com vue-async-operations - Managing async operations statuses in your Vue components
    auguwu 🤹 Common Kotlin utilities made for my personal usage, comes with SLF4J utilities, common extensions, ansi-colours, common Gradle utilities, and more.
    mpangburn A framework for functional types and operations designed to fit naturally into Swift.
    tarcieri micromath - Embedded-friendly math library featuring fast floating point approximations (with small code size) for common arithmetic operations, trigonometry, 2D/3D vector types, statistical analysis, and quaternions. Optimizes for performance and small code size at the cost of precision
    baidu-research Benchmarking Deep Learning operations on different hardware
    yuanqing A cheatsheet for common video processing operations in FFmpeg
    fuzz-productions A feature-light wrapper around Core Data that simplifies common database operations.
    borkdude Utility lib on top of rewrite-cljc with common operations to update EDN while preserving whitespace and comments.
    shrektan An R package that handles common dates operations using Rust
    hyperium http - A set of types for representing HTTP requests and responses
    http-rs http-service - Types and traits for standardizing async HTTP services
    http-rs http-service - Types and traits for standardizing async HTTP services
    dalek-cryptography curve25519-dalek-organism - A pure-Rust implementation of group operations on ristretto255 and Curve25519
    lukanetconsult Provides network address types for PHP
    vmarkovtsev Fast Longest Common Substring in Go
    hyperium mime - Strongly Typed Mimes
    offensivedev Perform operations on URLs like extracting paths, parameter names and/or values, domain name, host name (without HTTP[s]).
    http-rs http-client - Types and traits for http clients
    dflydev Apache MIME Types
    OyaCanli Common problems with specific types of Android OEMs
    hardik05 a c program containing vulnerable code for common types of vulnerabilities, can be used to show fuzzing concepts.
    Share this repo

    Related Repos


    HTTP Client
    18
    service_policy_kit is a Rust based toolkit for verifying HTTP services against policies.
    SpectralOps Service Policy Kit service_policy_kit is a Rust based toolkit for verifying HTTP services against policies. You can: Build a complete testing framewor
     
    HTTP Client
    68
    An experimental, work-in-progress PAM module for Tailscale
    tailscale Experimental Tailscale PAM Module This is a very very experimental Tailscale PAM module that allows you to SSH using your Tailscale credentials. This
     
    HTTP Client
    76
    Http request smuggling vulnerability scanner
    Sh1Yo Based on the amazing research by James Kettle. The tool can help to find servers that may be vulnerable to request smuggling vulnerability.
     
    HTTP Client
    218
    A sharp cut(1) clone.
    sstadick 🪓 hck A sharp cut(1) clone. hck is a shortening of hack, a rougher form of cut. A close to drop in replacement for cut that can use a regex delimiter
     
    HTTP Client
    14
    Yet another pager in Rust
    Riey rust-pager Yet another pager in Rust Features Vim like keybindings Search substring Mouse wheel support Install cargo install rust-pager Usage <comman
     
    HTTP Client
    3k
    Yet another HTTPie clone
    ducaale Yet another HTTPie clone
     
    HTTP Client
    12
    Tiny HTTP client for GET
    justjavac Simple, minimal-dependency HTTP client. Optional features for https with native-tls TLS implementations.
     
    HTTP Client
    14
    Yet another NixOS deployment tool
    zhaofengli Colmena Colmena is a simple, stateless NixOS deployment tool modeled after NixOps and Morph, written in Rust. It's a thin wrapper over Nix commands li
     
    HTTP Client
    105
    Clone trait that is object-safe
    dtolnay Clone trait that is object-safe This crate provides a DynClone trait that can be used in trait objects, and a clone_box function that can clone any si
     
    HTTP Client
    11
    Encoder and decoder for HTTP chunked transfer coding (RFC 7230 § 4.1)
    frewsxcv Encoder and decoder for HTTP chunked transfer coding.
     
    HTTP Client
    117
    Rust Client library for Apache Pulsar
    wyyerd This is a pure Rust client for Apache Pulsar that does not depend on the C++ Pulsar library. It provides an async/await based API, compatible with Tokio and async-std.
     
    HTTP Client
    35
    yet another youtube down loader (Git mirror)
    dertuxmalwieder yet another youtube (and more) down loader
     
    HTTP Client
    36
    FHC stands for Fast HTTP Checker, it's written in Rust
    Edu4rdSHL FHC stands for Fast HTTP Checker, it's written in Rust. Works on Linux, Windows, macOS, Android, Aarch64, ARM and possibly in your oven.
     
    HTTP Client
    70
    goji - Rust interface for Jira
    softprops goji a rust interface for jira install Add the following to your Cargo.toml file [dependencies] goji = "0.2" usage Please browse the examples director
     
    HTTP Client
    147
    hyperlocal-v07 - Hyper bindings for Unix domain sockets
    softprops hyperlocal Hyper client and server bindings for Unix domain sockets Hyper is a rock solid Rust HTTP client and server toolkit. Unix domain sockets pro