Commit Graph
22 Commits
Author SHA1 Message Date
Hamza El-Saawy e268c11e27 Add lint and go generate steps to CI (#254)
* Add lint and go generate stages to CI

Add CI step to verify `go generate` was run on repo.
Add linter stage to CI along with linter config file,
`.golangci.yml`.
Will likely prefer revive over static-check.

Updated README Contributing section on linting requirements.

Added sequence ordering to make sure lint and go generate stages run
before tests and build.
This way, build and tests are not run on code that could potentially:

    1. not build due to `gofmt` issues;
    2. contain bugs;
    3. have to be re-submitted after issues are fixed; or
    4. contain outdated Win32 syscall or other auto-generated files.

Signed-off-by: Hamza El-Saawy <hamzaelsaawy@microsoft.com>

* Fixed linter issues

Code changes to satisfy linters:

 - Ran `gofmt -s -w` on repo.
 - Broke up long lines.
 - When possible, changed names with incorrect initialism formatting
   - Added exceptions for exported variables.
 - Added exceptions for ALL_CAPS_WITH_UNDERSCORES code.
   - Switched to using `windows` or `syscall` definitions if possible;
     especially if some constants were unused.
 - Added `_ =` to satisfy error linter, and acknowledge that errors are
   being ignored.
 - Switched to using `errors.Is` and `As` in places, elsewhere added
   exceptions if error value was known to be `syscall.Errno`.
 - Removed bare returns.
 - Prevented variables from being overshadowed in certain places
   (ignoring cases of overshadowing `err`).
 - Renamed variables and functions (eg, `len`, `eventMetadata.bytes`) to
   prevent shadowing pre-built functions and imported pacakges.
 - Removed unused method receivers.
 - Added exceptions to certain unused (unexported) constants and
   functions.
   - Deleted unused `once` from `pkg/etw.providerMap`.
 - Renamed `noop.go` files to `main_other.go` or `doc.go`, to better fit
   style recommendations.
 - Added exceptions for non-secure use of SHA1 and weak crypto
   libraries.
 - Replaced `ioutil` with `io` and `os` (and `t.TempDir` in tests).
 - Added fully exhaustive checks for `switch` statements in `pkg/etw`.
 - Defined constant strings for `tools/mkwinsyscall`.
 - Removed unnecessary conversions.
 - Made sure `context.Cancel` was called.

Additionally, added `//go:build windows" constraints on files with
unexported code, since linter will complain about unused code on
non-Windows platforms.

Added a stub `main() {}` for `mkwinsyscall` for non-Windows builds, just in
case `//go:generate` directives are added to OS-agnostic files.

Signed-off-by: Hamza El-Saawy <hamzaelsaawy@microsoft.com>

* PR: spelling, constants, fuzzing

Moved HVSocket fuzzing tests to separate file with go 1.18 build
constraint.

Signed-off-by: Hamza El-Saawy <hamzaelsaawy@microsoft.com>

Signed-off-by: Hamza El-Saawy <hamzaelsaawy@microsoft.com>
2022-08-23 15:05:05 -04:00
Sebastiaan van Stijn 843abba285 backuptar: SecurityDescriptorFromTarHeader() don't decode twice (#233)
This may be a theoretical situation, but the tar headers may contain
both the old and new headers, in which case we would be decoding
both.

This patch rewrites the function to try the new headers first, and
return early if found, then fall back to trying the old headers.

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2022-03-23 10:28:27 -07:00
ambarve 7689f4c38c Merge pull request #220 from ambarve/encode_functions
functions SDDL, EA & Reparse encoding
2022-02-16 16:57:50 -08:00
Amit Barve 184126a9f0 backuptar: Export tar header parsing functions
Separates out Security Descriptor (SDDL), Extended Attribute (EA) and Reparse tag encoding
code into individual functions so that those functions can be reused in other code (like
CimFS layer writing)

Signed-off-by: Amit Barve <ambarve@microsoft.com>
2022-01-25 08:37:46 -08:00
Kevin Parsons 33a480106a backuptar: Fix sparse file handling
A recent OS change altered how sparse files are represented in backup
streams. This caused backuptar to no longer work with certain files. The
specific behavior that changed is as follows:
- Empty sparse files (size = 0), previously did not have any data or
  sparse block streams in the backup stream. Now, they will have a
  data stream with size = 0, and no sparse block streams.
- Sparse files with a single allocated range (e.g. a normal file that
  has the sparse attribute set) previously would not show as sparse in
  the backup stream. Now, they will show as sparse.

The old backuptar behavior assumed that if the sparse flag was set on
the data stream, then there would always be a set of sparse blocks
following. These changes break this assumption, and so require special
handling.

It is unsupported to have a data stream, marked sparse, that contains
file content AND a series of sparse block streams following. As far as
I can tell this is not a valid case for backup streams.

This change also cleans up some code and error messages, and expands on
the test coverage for backuptar.

For more information on backup stream format see: https://docs.microsoft.com/en-us/openspecs/windows_protocols/ms-bkup/f67950c8-d583-469a-83dd-c4ff4cedf533

Signed-off-by: Kevin Parsons <kevpar@microsoft.com>
2021-09-23 11:13:05 -07:00
Kathryn Baldauf 8f0d50b3b3 Revert "[Temporary] Revert Implement winio.GetFileStandardInfo FileInfo commits " 2021-04-22 10:33:11 -07:00
Kathryn Baldauf d80ed10b91 Revert "Replace local *FileInformationByHandleEx with x/sys/windows"
This reverts commit bfd546865c.

Signed-off-by: Kathryn Baldauf <kabaldau@microsoft.com>
2021-04-21 12:49:46 -07:00
Paul "TBBle" Hampson bfd546865c Replace local *FileInformationByHandleEx with x/sys/windows
We also get pre-defined constants instead of carrying our own copies.

However, this changes the public API winio.FileBasicInfo from using
syscall.Filetime to using windows.Filetime, as visible in
backuptar/tar.go.

Signed-off-by: Paul "TBBle" Hampson <Paul.Hampson@Pobox.com>
2021-02-11 22:50:55 +11:00
Thomas Way 9d8277341f Add build guards for all Windows imports 2021-01-21 23:24:01 +00:00
Paul "TBBle" Hampson cb5cf8987b Replace archive/tar fork with use of archive/tar
Since Go 1.6, archive/tar has gained public support for custom PAX
Records, so there's no need to maintain a fork of this library anymore.

We do end up with a fork of the PAX timestamp parsing/formatting
functions, but they are much less likely to change.

Signed-off-by: Paul "TBBle" Hampson <Paul.Hampson@Pobox.com>
2020-07-17 00:45:58 +10:00
Jiri Appl 5380df2ba5 Changes based on PR 2018-08-03 12:01:41 -07:00
Jiri Appl 350b9857de Update FileAttributes size to work on 32 bit platforms 2018-08-02 10:42:57 -07:00
John Starks 42a2f45ea5 Add support for EAs to Windows tars 2017-08-01 17:24:15 -07:00
John Howard 10390492a4 Fix filename length check alt data stream
Signed-off-by: John Howard <jhoward@microsoft.com>
2017-01-31 16:40:45 -08:00
Cezar Sa Espinola 94c0518b08 Include build tags to allow go get on non-Windows platforms. Fixes #30 2016-10-06 18:00:50 -03:00
Stefan J. Wernli 0ab2de7e65 Remove use of SDDL in tar headers
Switching to using straight binary instead of SDDL in tar headers to avoid failures in converting domain SIDs into/out of SDDL.

Fixes https://github.com/Microsoft/go-winio/issues/19
2016-05-11 17:05:17 -07:00
John Starks 93ca0b892a Backuptar: replace slash with backslash on link target 2016-04-11 15:45:43 -07:00
John Starks 346aee8003 Add backuptar.BasicInfoHeader helper function
This is useful for creating tar headers for things that don't have backup
streams, such as links.
2016-03-30 12:38:06 -07:00
John Starks 424d62c72e Use existing PAX headers for time
This removes the MSWINDOWS.* time fields and uses PAX times directly. I
didn't previously realize that PAX times could be negative, which
eliminates the need to store Windows times in a different format.

This also uses the LIBARCHIVE.creationtime field for creation times to
match OS X behavior.
2016-03-30 12:38:03 -07:00
John Starks b1cf780eb5 Use tar fork to encode Windows metadata correctly 2016-02-23 12:48:28 -08:00
John Starks 0186d1e4dd Fix encoding of Win32 file times 2016-02-22 14:04:34 -08:00
John Starks 0cd1930b37 Add experimental code to convert backup streams to tar streams
This code is experimental because it currently writes Windows metadata to
tar.Header.Xattrs, which is actually for POSIX extended attributes.
2016-02-18 20:41:01 -08:00