linux-scalability-benchmarks / libowfat / CHANGES

The default branch has multiple heads

Full commit
  save 8 bytes in taia.h for 64-bit systems
  add buffer_tosa (buffer writing to auto-growing stralloc)
  add iarray

  add uint64 pack and unpack routines
  fix subtle typo in sub_of (David Sirovsky)
  work around gcc bugs

  add fmt_strm
  add iob_addbuf_munmap
  add socket_deferaccept
  catch one more case in umult64 (Tomi Jylhä-Ollila)

  fix really pathological case where io_timeouted would never
    start over from the beginning because always new accept()ed
    connections came in and got newer, higher descriptors since the last
    io_timeouted loop.  (Dirk Engling)
  add some int overflow check macros to rangecheck.h
  fmt_ip6 compresses at best spot, not at first spot (Nikola Vladov)
  use inttypes.h to declare ints in uint*.h
  escape more in fmt_ldapescape
  try to catch malicious input in textcode fmt_* functions
  fmt_xlonglong was utterly broken (Johannes Vetter)

  array_allocate no longer truncates the array
  array_get now not only checks whether the element fits in the
    allocates space, it also needs to be in the initialized space.
  add -D_REENTRANT to CFLAGS so libowfat can be used in multi-threaded
  further Windoze support (test/io5.c works, gatling still doesn't)
    This is just to get gatling to work, I may remove it again after
  implement Nikola's idea to remove limit number of strings in errmsg
  add taia_half
  add cdb
  add rangecheck.h
  add io_block
  make socket_(tc|ud)p[46] actually return non-blocking sockets as
    documented (Richard Lyons)
  fix for NetBSD 3.0 (Their /sys/types.h actually does not define u_char
    unless you #define _NETBSD_SOURCE, and then their CMSG_* macros use
    it.  This is horrible even by OpenBSD standards)
  remove support for (it's no longer delegated)
  add asm versions of imult64 and umult64 for x86_64
    (22 cycles -> 12 cycles on my Athlon 64)
  use size_t and ssize_t instead of unsigned long et al
  add iob_bytesleft
  don't leak memory in test/httpd

  fix scan_to_sa (Tim Lorenz)
  turns out we can not do file descriptor passing on OpenBSD
    if _XOPEN_SOURCE is defined, which is needed for Solaris.
    OpenBSD sucks.  I checked in a _really_ kludge now.  Please do not
    use OpenBSD if you have a choice.  Or Solaris, for that matter.
  turns out the imult routines (which I never used) were incorrect.
    Noted by Matthew Dempsky
  open_* from open.h now open in large file mode

  also recognize EPFNOSUPPORT as EAFNOSUPPORT (groan)
  fix a few man pages
  optimize fmt_base64 (Dan Gundlach)
  gcc 4 cleanups (mostly unsigned char* vs char*)
  fix scan_xlong, scan_xlonglong and scan_8long
  remove a few gcc 4 warnings
  work around freebsd 5.4 brokenness (if you don't have IPv6 in the
    kernel, socket(PF_INET6,SOCK_STREAM,0) returns EPROTONOSUPPORT
    instead of EPFNOSUPPORT, which basically says "yeah, I know IPv6,
    but TCP?  never heard of it")
  remove even more warnings
  64-bit cleanliness issue with auto-NULL-appending macros
  IRIX compatibility (yuck!)

  uh, the scope_id detection #defined the wrong constant.  libowfat
    always thought there was no scope_id.  Oops.
  #include <unistd.h> in io/io_sendfile.c (broken OpenBSD, thx Rob)
  add scan_urlencoded2 (like scan_urlencoded but will not convert '+' to
    ' '; needed for web servers, so they can serve libstdc++.tar.gz)
  fix iob_write to handle failure properly
  document that the iob_write callback should limit itself
  fix mmap_shared
  add iob_free, add man pages for iob_free and iob_reset
  fix descriptor leak in iob_addfile_close if the range was 0 (oops)

  errno cleanup and man page updates (Rolf Eike Beer)
  implement iob_prefetch with madvise MADV_WILLNEED if it's defined
  extend API To read line/token to stralloc to allow clearing the
    stralloc first.
  add stralloc_zero to clear a stralloc
  add buffer_putsflush
  add stralloc_catm and stralloc_copym
  add buffer_putm and buffer_putmflush
  cleanups in stralloc and buffer:
    int -> long for sizes
    char -> unsigned char for strings
  buffer_getline is now a function, not a macro
  add iob_write (send io batch through callback, e.g. for SSL)
  add errmsg_info and errmsg_infosys to write to stdout instead
  epoll fix (how could this ever work?)

  add errmsg API
  work around broken Linux sendfile API (offset 64-bit but count 32-bit)
  add io_appendfile, io_readwritefile
  support in addition to in dns_name (adds one
    parameter to dns_name6_domain and two constants in dns.h)
  Solaris compatibility for io_passfd and io_receivefd

  for some reason, a botched dependency slipped in the the Makefile

  oops, I botched havealloca.h, which was not generated but static
    Now it is generated.

  add io_socketpair
  add io_passfd and io_receivefd (and test/fdpassing.c)
  io_trywrite and io_waitwrite not ignore SIGPIPE
  add man pages for libio, safemult
  fix possible signal race in io_tryread and io_trywrite (Scott Lamb)
  fix byte_rchr return value (Marcus Winkler)
  fix bug in mmap code path of io_sendfile (David Leadbeater)

  make libowfat compile on BSD again (sorry, and thanks to everyone who
    sent me a patch :-D)
  add iob_addfile_close, needed for gatling 0.5+
  add test/client and test/server, two simple TCP shell interfaces

  add Linux SIGIO support to IO
  expand IO api to be able to cope with edge triggered event
    notification: introduce io_eagain
  the integer scan routines should only write *dest if they actually
    scanned something
  io_sendfile and iob_send should return -1 to -3 just like io_trywrite
  make io_waituntil actually take an "until", not a "how long"
  turns out that BSD kqueue is actually Free/OpenBSD kqueue -- NetBSD
    doesn't have it.  That means I'll need some adaptive two-threads-
    running-poll approach to get C10k type scalability on NetBSD :-(
  turns out that BSD sendfile is actually FreeBSD sendfile -- neither
    OpenBSD nor NetBSD have it (as of 3.4 and 1.6.1).  That means I'll
    need to try using mmap on OpenBSD and NetBSD to get zero-copy TCP.
  guard against same event being signalled twice (confused our list
  add support for Solaris /dev/poll
  add lose32 support (broken, please don't use!)
  head -1 -> head -n 1
  apending 0 bytes to an empty array would fail it
  remove socket_sendfile now that we have io_sendfile
  break out alloca #include dependency into havealloca.h
  support HP-UX sendfile64 (thanks to Rolf Eike Beer)
  support Solaris sendfile64
  support MacOS X sendfile (and comment it out again, the headers
    declare it but it's not actually there) (thanks to Bernhard Schmidt)
  support AIX 5 (thanks to Lutz Chwala and Arthur Erhardt)
  fix ip6_fmt (martin paljak)

  add buffer_fromsa (make buffer from stralloc)
  add API for integer multiply with overflow detection
  change length counters from int to long for 64-bit platforms
  add array API from
  oops, had a declaration and man page for taia_addsec but not the
    function itself
  add buffer functions to write strerror(errno)
  add io API supporting poll, epoll and kqueue
  remove obsolete "extern" from header files
  add iob API to send several buffers and files in one batch

  man page update (document stralloc return values)
  add stralloc_chop and stralloc_chomp
  add buffer_putsa, buffer_get_token_sa and buffer_getline_sa
  extended uudecode test.  See comment at top for details.
  fix #include in ndelay*.3 (Hynek Schlawack)
  add stralloc_diff and stralloc_diffs (my invention)
  scan_ip6 returned 1 for "::" (Uwe Ohse)
  add el-cheapo MIME decoding to test/uudecode
  make install forgot to install ndelay.h
  fix typos in several man pages (Hynek Schlawack)
  add stralloc versions of textcode API (Kai Ruemmler)
  add html to textcode ('<' to '&lt;' etc)
  add fmt_human and fmt_humank (format numbers ala ls -H/-h)
  add fmt_httpdate and scan_httpdate
  fix typo breaking buffer_GETC in buffer (Marcus Winkler)
  fix typo breaking fmt_long for dest==NULL
  add fmt_*longlong()
  add range check to scan_ulong, scan_ulonglong, scan_uint and
  extended socket API; you can now pass NULL for results you don't want
  rename Makefile to GNUmakefile; create Makefile target
  add buffer_get_token_pred and buffer_get_token_sa_pred

  avoid bus errors in byte_copy
  byte_rchr was completely broken
  add case, iopause, tai, taia, openreadclose and ipv6-enhanced dns

  fixed several bugs in test/uudecode.c
  add uninstall target
  add uint16_read API like the uint32_read one
  add buffer_putnlflush
  lots of general clean-ups from Jukka Zitting:
    add FMT_LONG to fmt.h (FMT_ULONG plus 1 for sign)
    fmt_strn did not work for out==NULL
    fix inconsistencies in man pages
  make scan_urlencode do the '+' -> ' ' transformation

  add textcode api for uuencode/uudecode, base64, quoted printable,
    url-encoding and yenc.

  fix fmt_long (didn't count the '-'), which in turn broke
  referenced wrong include file in stralloc_ready and stralloc_readyplus
    man page.

  add comment to stralloc.h that explains the structure (Markus Brischke)
  fix socket routines (two cut-and-paste errors)

  fmt_str did not check for out==NULL!  Thanks, Uwe Ohse.
  Updated to buffer to fix read buffers.  Thanks, David Lichteblau.
  Oops!  byte_copy had a trivial and dumb typo in it that I'm unsure how
    I could have missed it.
  add mmap man pages.
  update and add socket man pages.
  don't include str.h from fmt.h
  document error signalling for the mmap functions.

  BSD compatibility.
  fix mmap_shared.

  add buffer_putspace
  fix b0read prototype in buffer/buffer_0*
  scan_ip6 will not transparently scan IPv4 addresses and save them as
    v4-mapped addresses (::ffff:
  byte_copy was sped up (but made larger in the process)

  changed name to libowfat.
  fixed fmt_ulong (did not output 0 correctly).
  added buffer.
  extended buffer API to include buffer_putulong() and friends.
  oops, the read buffering was completely broken!
  add mmap library (idea from Ingo Oeser)

  made subdirectories for the different libraries.
  moved the sources into the corresponding subdirectory.
  imported my man pages from libdjb.
  removed fmt_int.c and fmt_uint.c (they are macros in fmt.h).
  corrected comment in open.h for open_excl.
  wrote new man pages for fmt_double, scan_double, the sign fmt_ and
    scan_ routines, the whitespace and charset scan_ routines, and the
    str and stralloc routines.

  implemented stralloc.

  implemented uint16, uint32 and uint64.  The header files try to
    define shortcut endianness conversion routines that do not convert
  implemented open (I hope I got open_excl right, I couldn't find an

  implemented the scan, fmt and str interfaces.
  added adapted fmt_double and scan_double from diet libc.

  initial release.
  implemented the byte interface.