Home / Golang / Networking

Package raw enables reading and writing data at the device driver level for a network interface. MIT Licensed.

raw Package raw enables reading and writing data at the device driver level for a network interface. MIT Licensed. For more information about using raw sockets with Ethernet frames in Go, check out my blog post: Network Proto
Information
Category: Golang / Networking
Watchers: 14
Star: 421
Fork: 77
Last update: Sep 27, 2023
Resource links
https://github.com/mdlayher/raw

raw builds.sr.ht status GoDoc Go Report Card

Package raw enables reading and writing data at the device driver level for a network interface. MIT Licensed.

For more information about using raw sockets with Ethernet frames in Go, check out my blog post: Network Protocol Breakdown: Ethernet and Go.

Portions of this code are taken from the Go standard library. The Go standard library is Copyright (c) 2012 The Go Authors. All rights reserved. The Go license can be found at https://golang.org/LICENSE.

Stability

At this time, package raw is in a pre-v1.0.0 state. Changes are being made which may impact the exported API of this package and others in its ecosystem.

The general policy of this package is to only support the latest, stable version of Go. Compatibility shims may be added for prior versions of Go on an as-needed basis. If you would like to raise a concern, please file an issue.

If you depend on this package in your applications, please vendor it or use Go modules when building your application.

15 Open More issues
Closed

raw: use runtime epoll support

This allows us to call Close() while an existing Read/Write call is in progress.

Yeah, this is ugly af.

opened Mar 1, 2019 by hugelgupf 20
Closed

Set read timeout on file descriptor

Using poll before read is simple and works with timeouts.

opened Nov 1, 2017 by corny 14
Closed

raw: potential regression after Go 1.12 runtime network poller integration

From a conversation in https://github.com/mdlayher/raw/pull/40.

This commit broke router7’s dhcp4 client: rtr7/router7#25

After a git revert f434146a17ecdf185e28b9ae8457ef45ee82077a, everything works as expected. At HEAD, dhcp4 gets one reply, then fails to ever send packets on the network interface, resulting in the > DHCP lease expiring.

Haven’t investigated it any further, but perhaps this is sufficient to spot the mistake?

/cc @hugelgupf @stapelberg

bug 
opened Mar 5, 2019 by mdlayher 11
Closed

Add ability to access DGRAM packet sockets on Linux.

Not sure this is exactly what you would want, so I thought I'd just send it for review.

opened Dec 11, 2017 by hugelgupf 7
Closed

Workaround deprecated functionality on OpenBSD.

Syscall BIOCSSEESENT as used in setBPFDirection is deprecated on OpenBSD. Some quick checking in CVS makes me wonder if it was ever supported. BIOCSDIRFILT however does work as intended.

opened Jan 24, 2019 by arktos 6
Closed

BPF BSD Header Completion in raw_bsd.go

Should the flag be 1 instead of 0? 1 will allow for MAC spoofing on the wire which i believe is what the comment is suggesting.

Line 202 // Do not automatically complete source address in ethernet headers if err := syscall.SetBpfHeadercmpl(fd, 0); err != nil { return 0, err }

0 flag sets automatic header completion per BPF man page (read interface address will be written in place of frame provided to BPF for outgoing transaction) BIOCSHDRCMPLT BIOCGHDRCMPLT (u_int) Set or get the status of the ``header complete'' flag. Set to zero if the link level source address should be filled in automatically by the interface output routine. Set to one if the link level source address will be written, as provided, to the wire. This flag is initialized to zero by default.

opened Jul 18, 2017 by bpillatsch 5
Open

htons should depend on host endianness

func htons should take host endianness into account:

func htons(i uint16) uint16 {
	return (i<<8)&0xff00 | i>>8
}

Depending on host endianness this should be a no-op or not.

The issue was spotted when trying to use this lib on a device with a different endianness...

opened Dec 16, 2021 by bhesmans 0
Open

Error slice bounds out of range. Help!

Hello, I encountered a problem during use in Macos, As follows:

panic: runtime error: slice bounds out of range [:4098] with capacity 4096

goroutine 886516 [running]:
github.com/mdlayher/raw.(*packetConn).ReadFrom(0xc0061cd6e0, {0xc005833280, 0x80, 0x80})
    /github.com/mdlayher/raw/raw_bsd.go:163 +0x9e5
github.com/mdlayher/raw.(*Conn).ReadFrom(0xc00462e278, {0xc005833280, 0x80, 0x80})
    /github.com/mdlayher/raw/raw.go:47 +0x99

I searched the source code and found the problem here on raw_bsd.go:

func (p *packetConn) ReadFrom(b []byte) (int, net.Addr, error) {
 ......
 
	  // Skip past BPF header to retrieve ethernet frame
	  out := copy(b, buf[bpfl:bpfl+n])
 ......
 }

I carefully sorted out your logic. I think there's a small problem. Should it be:

  func (p *packetConn) ReadFrom(b []byte) (int, net.Addr, error) {
  .......
  
	  // Skip past BPF header to retrieve ethernet frame
	  out := copy(b, buf[bpfl:n])
  ......
  }

I don't know if the understanding is correct. Please correct it. Thank you!

opened Dec 6, 2021 by woguwo 0
Open

SetSockoptInt and GetSockoptInt support

This adds support for getting and setting socket options.

opened Sep 24, 2021 by joewilliams 0
Open

use unix.Write to send packets to raw socket

Specifying a socketaddr is unnecessary when writing packets to a raw socket. According to packet(7) the supplied buffer should contain a physical-layer header. The sockaddr_ll is used for SOCK_DGRAM.

SOCK_RAW packets are passed to and from the device driver without any changes in the packet data. When receiving a packet, the address is still parsed and passed in a standard sockaddr_ll address structure. When transmitting a packet, the user-supplied buffer should contain the physical-layer header. That packet is then queued unmodified to the network driver of the interface defined by the destination address.

SOCK_DGRAM operates on a slightly higher level. The physical header is removed before the packet is passed to the user. Packets sent through a SOCK_DGRAM packet socket get a suitable physical-layer header based on the information in the sockaddr_ll destination address before they are queued.

http://man7.org/linux/man-pages/man7/packet.7.html

opened May 8, 2020 by pyther 0
Open

add setMulticast function

This allows the interface to subscribe to a link-layer multicast address.

I've written a small program to proxy eap packets from one interface to another. EAP (802.1x Auth) packets are sent to a link-layer multicast address. The Interface must either subscribe to the Multicast Address or be put in promisc mode. https://github.com/pyther/goeap_proxy/

I wanted to put this out there as a starting point for discussion. Let me know what you think. Not sure if this is the best way to accomplish this? Maybe exposing SetSockoptPacketMreq to raw.conn is some capacity would allow for more flexibility?

opened May 2, 2020 by pyther 1
Open

raw: support LinuxSockDGRAM on BSD

opened Jun 25, 2019 by ronanjs 0

v0.1.0(Feb 21, 2022)

Please see https://github.com/mdlayher/raw#unmaintained. The recommended replacement package for Linux is https://github.com/mdlayher/packet, and a v1.0.0 stable release for that package has been tagged.

Contents

    Microsoft The Microsoft JDBC Driver for SQL Server is a Type 4 JDBC driver that provides database connectivity with SQL Server through the standard JDBC application program interfaces (APIs).
    rvflash AWQL driver for Go's sql package
    alaisi Asynchronous PostgreSQL Java driver
    mdlayher Go package capable of generating waveform images from audio streams. MIT Licensed.
    JoshClose Library to help reading and writing CSV files
    tplgy Header-only C++11 library to encode/decode base64, base64url, base32, base32hex and hex (a.k.a. base16) as specified in RFC 4648, plus Crockford's base32. MIT licensed with consistent, flexible API.
    mkery A demo for the *programatic* reading and writing of user code in Jupyter notebooks 4 code analysis fun
    bchavez :headphones: A NoSQL C#/.NET RethinkDB database driver with 100% ReQL API coverage.
    mdlayher Package arp implements the ARP protocol, as described in RFC 826. MIT Licensed.
    ulikunitz Pure golang package for reading and writing xz-compressed files
    0904-mansi In this project, we have built a driver drowsiness detection system that will detect if the eyes of the driver are close for too long and infer if the driver is sleepy or inactive.
    mdlayher Package dhcp6 implements a DHCPv6 server, as described in RFC 3315. MIT Licensed.
    mdlayher Package prombolt provides a Prometheus metrics collector for Bolt databases. MIT Licensed.
    go-sql-driver Go MySQL Driver is a MySQL driver for Go's (golang) database/sql package
    AndrewBennet :books: :iphone: Reading List - an iOS app to track personal reading lists
    rust-bio rust-htslib - This library provides HTSlib bindings and a high level Rust API for reading and writing BAM files
    FaceOnLive On-Device ID Card & Passport & Driver License Recognition SDK for Android
    ClosedXML ClosedXML is a .NET library for reading, manipulating and writing Excel 2007+ (.xlsx, .xlsm) files. It aims to provide an intuitive and user-friendly interface to dealing with the underlying OpenXML API.
    GameTechDev XeGTAO is an open source, MIT licensed, DirectX/HLSL implementation of the Practical Realtime Strategies for Accurate Indirect Occlusion, GTAO
    WireGuard Package wgctrl enables control of WireGuard interfaces on multiple platforms.
    Sensirion lin-bus — LIN bus driver traits and protocol implementation
    Share this repo

    Related Repos


    Networking
    19
    Create, manage and execute http requests from the terminal
    PierreKieffer _ _ _ _ _ | |_| |_| |_ _ __ ___| |_ __ _ _ _ | |_____ _ _ | ' \ _| _| '_ \___| _/ _` | ' \| / / -_) '_| |_||
     
    Networking
    341
    GoNN is an implementation of Neural Network in Go Language, which includes BPNN, RBF, PCN
    fxsjy GoNN Neural Network in GoLang Feature BackPropagation Network / RBF Network / Perceptron Network Parallel BackPropagation Network (each neural has its
     
    Networking
    6
    Simple HTTP client for Go
    hadihammurabi GoRe (Go Requester) Simple HTTP client for Go Example g := gore.New( gore.WithBaseURL("https://api.products.com"), ) resp, err := g.Get("/entities"
     
    Networking
    8
    A simple Go server that broadcasts any data/stream
    schollz broadcast A simple Go server that broadcasts any data/stream usage data You can POST data. curl -X POST --data-binary "@111.png" localhost:9222/test.p
     
    Networking
    7
    Lightweight HTTP server to handle webhooks from listmonk and forward it to different messe...
    joeirimpan listmonk-messenger Lightweight HTTP server to handle webhooks from listmonk and forward it to different messengers. Supported messengers Pinpoint Deve
     
    Networking
    4
    Cloud-Z gathers information and perform benchmarks on cloud instances in multiple cloud pr...
    CloudSnorkel Cloud-Z Cloud-Z gathers information and perform benchmarks on cloud instances in multiple cloud providers. Cloud type, instance id, and type CPU infor
     
    Networking
    3.1k
    Expose localhost servers to the Internet
    progrium localtunnel What happened to localtunnel? After pioneering instant public tunnels to localhost, many people copied the project and started businesses
     
    Networking
    259
    Distributed tracing using OpenTelemetry and ClickHouse
    uptrace Distributed tracing backend using OpenTelemetry and ClickHouse Uptrace is a distributed tracing system that uses OpenTelemetry to collect data and Cli
     
    Networking
    8
    Automatically exposes the remote container's listening ports back to the local machine
    ruoshan Auto-portforward (apf) A handy tool to automatically set up proxies that expose the remote container's listening ports back to the local machine. Just
     
    Networking
    0
    An encrypted photo album for home network use
    codazoda X2 An (eventually encrypted) private photo album for home network use. Getting Started The server should run on any Mac, Linux, or Windows machine but
     
    Networking
    18
    USENET-inspired decentralized internet discussion system
    mrusme =============================================================================== INTERACTIVE ASYNC / FULL DUPLEX ===============
     
    Networking
    3
    🪝 Make requests to HTTP servers with Hackney
    gleam-lang Hackney Bindings to Erlang's HTTP client, hackney. import gleam/hackney import gleam/http.{Get} import gleeunit/should pub fn main() { // Prepare a
     
    Networking
    0
    It is simple proxy to work with tcp connection
    gelleson It is simple proxy to work with tcp connection
     
    Networking
    8
    Help fuzz various protocols and waits for ping backs Integrates LDAP server and JNDI paylo...
    LeakIX l9fuzz Fuzzes various protocols with JNDI LDAP payloads and listen for ping backs Features Low CPU/Memory footprint Integrated LDAP server Trace orign
     
    Networking
    3
    A light-weight high-performance UDP sockets library
    org-arl DirectSockets A light-weight high-performance UDP sockets library. Background The Julia standard library Sockets provides a great UDPSocket implementa