EVA-2020-02.git
3 years agofeat(bkgpslog):Consolidate write ops into one function
Steven Baltakatei Sandoval [Thu, 2 Jul 2020 00:55:23 +0000 (00:55 +0000)]
feat(bkgpslog):Consolidate write ops into one function

Create metafunction 'magicWriteBuffer' to be triggered for
asynchronous appending of location files into tar file via
appendArgTar function (new) once buffer filled in main logging loop.

Create appendArgTar function to append a bash variable as a file to a
tar file.

3 years agodebug(bkgpslog):testing debug of gpx kml output
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 22:06:58 +0000 (22:06 +0000)]
debug(bkgpslog):testing debug of gpx kml output

3 years agofix(bkgpslog):Fix output files having the same names
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 21:42:21 +0000 (21:42 +0000)]
fix(bkgpslog):Fix output files having the same names

3 years agofeat(bkgpslog):Added debug message when main function completes
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 21:25:00 +0000 (21:25 +0000)]
feat(bkgpslog):Added debug message when main function completes

3 years agofix(bkgpslog):Clean up how tar appended, version file included
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 21:23:28 +0000 (21:23 +0000)]
fix(bkgpslog):Clean up how tar appended, version file included

3 years agochore(bkgpslog):Add timestamp to version content.
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 21:18:02 +0000 (21:18 +0000)]
chore(bkgpslog):Add timestamp to version content.

3 years agochore(bkgpslog):Include version in appendtest
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 21:15:32 +0000 (21:15 +0000)]
chore(bkgpslog):Include version in appendtest

3 years agodebug(bkgpslog):Clarified debug messages
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 21:07:54 +0000 (21:07 +0000)]
debug(bkgpslog):Clarified debug messages

3 years agofix(bkgpslog):Fix secure chunk cleanup code
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 21:03:59 +0000 (21:03 +0000)]
fix(bkgpslog):Fix secure chunk cleanup code

3 years agodebug(bkgpslog):Add more debug messages; clarified tar workdir
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 20:59:08 +0000 (20:59 +0000)]
debug(bkgpslog):Add more debug messages; clarified tar workdir

3 years agodebug(bkgpslog):Add more verbose debug messages
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 20:51:42 +0000 (20:51 +0000)]
debug(bkgpslog):Add more verbose debug messages

3 years agodebug(bkgpslog):Add more verbose debug code
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 20:47:02 +0000 (20:47 +0000)]
debug(bkgpslog):Add more verbose debug code

3 years agodebug(bkgpslog):Add additional debug for output file path vars
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 20:42:23 +0000 (20:42 +0000)]
debug(bkgpslog):Add additional debug for output file path vars

3 years agofix(bkgpslog):Minor formatting
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 20:29:22 +0000 (20:29 +0000)]
fix(bkgpslog):Minor formatting

3 years agofeat(bkgpslog):Append to preexisting tar if possible
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 20:27:41 +0000 (20:27 +0000)]
feat(bkgpslog):Append to preexisting tar if possible

3 years agofix(bkgpslog):Add missing shifts in processArguments()
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 20:04:26 +0000 (20:04 +0000)]
fix(bkgpslog):Add missing shifts in processArguments()

3 years agofeat(bkgpslog):Add more verbose error message in processArguments()
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 20:02:09 +0000 (20:02 +0000)]
feat(bkgpslog):Add more verbose error message in processArguments()

3 years agofix(bkgpslog):Fix incorrectly selected argument
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 19:57:29 +0000 (19:57 +0000)]
fix(bkgpslog):Fix incorrectly selected argument

3 years agodoc(bkgpslog): Update usage
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 19:51:23 +0000 (19:51 +0000)]
doc(bkgpslog): Update usage

3 years agofeat(bkgpslog): Remove termproary working dir at end
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 19:45:22 +0000 (19:45 +0000)]
feat(bkgpslog): Remove termproary working dir at end

- Remove temporary working directory at end of main function.

- Initialize option variables in case they are set earlier.

- Add `--temp-dir` option to permit user to specify temporary working
directory.

3 years agofix(bkgpslog): Fix broken working dir name
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 19:25:47 +0000 (19:25 +0000)]
fix(bkgpslog): Fix broken working dir name

- Fix broken working dir variable (was missing script start time)

- Remove UTC as default TZ (will use parent shell's env var TZ). Can
  still be customized using `--time-zone` option

- Add logic for creating temporary working directory for possible
future `--temp-dir` option. Working dir hard defaults to
`/dev/shm` (tmpfs) for now.

3 years agofeat(bkgpslog): Append to daily tar
Steven Baltakatei Sandoval [Wed, 1 Jul 2020 18:44:52 +0000 (18:44 +0000)]
feat(bkgpslog): Append to daily tar

* Set version to 0.1.0.

* Rewrote write loop to append location data to tar file instead of
writing each file written by each buffer round directly to
disk. Tar contains individually encrypted and compressed files; no
attempt at merging location data between buffer rounds was attempted.

* Add functions:

- setTimeZoneEV (exports TZ)
- dateShort (returns current date in `YYYYmmdd` format via stdout)
- timeDuration (given seconds, returns ISO-8601 period; Ex: PT60S)
- displayMissing (displays missing apps, files, and dirs)
- setScriptTTL (sets script TTL given "day" or "hour")

* Set default script TTL to "day" (was "hour")

* Set default TZ to UTC. Added option `--time-zone`.

3 years agodoc(loc/README): Show how to disable swap file
Steven Baltakatei Sandoval [Tue, 30 Jun 2020 19:46:30 +0000 (19:46 +0000)]
doc(loc/README): Show how to disable swap file

Disabling swap file is important for reducing probability that
unencrypted data is written to disk.

3 years agodoc(location):Describe how to disable swap file
Steven Baltakatei Sandoval [Tue, 30 Jun 2020 17:15:30 +0000 (17:15 +0000)]
doc(location):Describe how to disable swap file

3 years agodoc(location):Add html version of location README
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 22:28:33 +0000 (22:28 +0000)]
doc(location):Add html version of location README

3 years agodoc(location): Updated README for loc, exported ODT version
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 22:26:06 +0000 (22:26 +0000)]
doc(location): Updated README for loc, exported ODT version

3 years agofeat(bkgpslog):Add ~/.local/bin to PATH
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 22:10:13 +0000 (22:10 +0000)]
feat(bkgpslog):Add ~/.local/bin to PATH

If apps for bkgpslog stored in `~/.local/bin`, make sure to add it to
front of PATH.

3 years agodoc(location):Update README with compress and encrypt example
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 22:07:39 +0000 (22:07 +0000)]
doc(location):Update README with compress and encrypt example

3 years agofix(bkgpslog):Add quotation marks for output path vars
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 22:06:35 +0000 (22:06 +0000)]
fix(bkgpslog):Add quotation marks for output path vars

May be necessary if path specified by `--output` option contains
whitespace.

3 years agotest(bkgpslog): Test 'tee /dev/null' as passthrough-function
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 21:41:35 +0000 (21:41 +0000)]
test(bkgpslog): Test 'tee /dev/null' as passthrough-function

3 years agotest(bkgpslog):Group all processing and save commands
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 21:26:58 +0000 (21:26 +0000)]
test(bkgpslog):Group all processing and save commands

3 years agofix(bkgpslog):Add missing dollarsign to vars
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 21:21:17 +0000 (21:21 +0000)]
fix(bkgpslog):Add missing dollarsign to vars

3 years agotest(bkgpslog): Regroup file write commands
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 21:17:25 +0000 (21:17 +0000)]
test(bkgpslog): Regroup file write commands

3 years agotest(bkgpslog):Construct command string as var before executing
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 21:01:44 +0000 (21:01 +0000)]
test(bkgpslog):Construct command string as var before executing

3 years agofix(bkgpslog):Fix file write command
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 20:44:48 +0000 (20:44 +0000)]
fix(bkgpslog):Fix file write command

Removed quotation marks so command chars taken literally, not treated
as a word.

3 years agofix(bkgpslog):Add missing fi
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 20:32:34 +0000 (20:32 +0000)]
fix(bkgpslog):Add missing fi

3 years agofeat(bkgpslog):Implement compression and encryption
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 20:30:50 +0000 (20:30 +0000)]
feat(bkgpslog):Implement compression and encryption

Add compression option.

Implement compression of output files.

Implement encryption of output files.

3 years agotest(bkgpslog):Add age recipient string processing code
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 19:46:35 +0000 (19:46 +0000)]
test(bkgpslog):Add age recipient string processing code

3 years agofeat(bkgpslog):Add encryption option
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 19:31:21 +0000 (19:31 +0000)]
feat(bkgpslog):Add encryption option

Add encryption option via `age`. See:
https://github.com/FiloSottile/age .

Add `-e, --encrypt` option for specifying output to be encrypted.

Add `-r --recipient [ pubkey string ]` option for specifying
recipients of encrypted output.

Add code to validate recipient pubkey strings.

Not added (yet): encryption of output files.

3 years agodoc(README.org):Update main README
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 18:40:04 +0000 (18:40 +0000)]
doc(README.org):Update main README

All major sections populated. `age` use described.

3 years agofix(bkgpslog):processArguments: Shorten short option strings
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 16:26:16 +0000 (16:26 +0000)]
fix(bkgpslog):processArguments: Shorten short option strings

3 years agodoc(location):Add README for location logging, add age ref files
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 16:06:23 +0000 (16:06 +0000)]
doc(location):Add README for location logging, add age ref files

Create draft of README for Location Logging operations performed by
ninfacyzga-01.

Add copy of age encryption software (v1.0.0-beta2 binaries compatible
with Raspbian) and age version 1 specification.

3 years agofeat(archive):Add baltakatei OpenPGP public key
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 11:56:07 +0000 (11:56 +0000)]
feat(archive):Add baltakatei OpenPGP public key

Fingerprint:

pub   rsa4096/0xA0A295ABDC3469C9 2017-10-11 [C] [expires: 2022-07-08]
      Key fingerprint = 3457 A265 922A 1F38 39DB  0264 A0A2 95AB DC34 69C9
uid                   [ultimate] Steven Sandoval <baltakatei@gmail.com>
uid                   [ultimate] Steven Sandoval <baltakatei@alumni.stanford.edu>
uid                   [ultimate] [jpeg image of size 1846]
sub   rsa4096/0x6DD7D496916A1253 2018-05-16 [E] [expires: 2022-07-07]
      Key fingerprint = 5E55 5FC6 1C85 871E 813B  5BCF 6DD7 D496 916A 1253
sub   rsa4096/0x57DA57D9517E6F86 2018-05-16 [S] [expires: 2022-07-07]
      Key fingerprint = 38F9 6437 C83A C88E 28B7  A952 57DA 57D9 517E 6F86
sub   rsa4096/0x5F9D26B9A598A2D3 2018-05-16 [A] [expires: 2022-07-07]
      Key fingerprint = EDCA 7EE7 D09E 7F2E 1DF6  A229 5F9D 26B9 A598 A2D3

3 years agofix(bkgpslog):Comment out debug code causing /var/mail/ noise
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 11:50:38 +0000 (11:50 +0000)]
fix(bkgpslog):Comment out debug code causing /var/mail/ noise

3 years agofeat(bkgpslog):Enable hour TTL, cleanup functions
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 11:43:35 +0000 (11:43 +0000)]
feat(bkgpslog):Enable hour TTL, cleanup functions

Enable a new feature that breaks the while loop at the top of the next
hour.

Include commented-out code to break while loop at the top of the next
day.

Set buffer round time to 60 seconds (nominal time between writing of
buffer data to a new file on disk).

3 years agochore(bkgpslog):Remove unsetting of superfluous vars
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 01:47:45 +0000 (01:47 +0000)]
chore(bkgpslog):Remove unsetting of superfluous vars

Variables were removed in streamlining of buffer processing.

3 years agofix(bkgpslog):Fix malformed variable in output filename
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 01:42:10 +0000 (01:42 +0000)]
fix(bkgpslog):Fix malformed variable in output filename

3 years agochore(bkgpslog):Add comment noting ISO-8601 format of filename
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 01:37:46 +0000 (01:37 +0000)]
chore(bkgpslog):Add comment noting ISO-8601 format of filename

3 years agofix(bkgpslog):Added quotes back to variable
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 01:36:15 +0000 (01:36 +0000)]
fix(bkgpslog):Added quotes back to variable

3 years agofeat(bkgpslog):Directly convert and write buffer to GPX, KML
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 01:33:34 +0000 (01:33 +0000)]
feat(bkgpslog):Directly convert and write buffer to GPX, KML

3 years agofix(bkgpslog):Make sure buffer variables are unset each round
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 00:37:20 +0000 (00:37 +0000)]
fix(bkgpslog):Make sure buffer variables are unset each round

3 years agofix(bkgpslog):Explicitly write instead of append buffer
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 00:32:58 +0000 (00:32 +0000)]
fix(bkgpslog):Explicitly write instead of append buffer

3 years agofix(bkgpslog):Fix malformed xml by saving 1 file per buffer round
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 00:23:52 +0000 (00:23 +0000)]
fix(bkgpslog):Fix malformed xml by saving 1 file per buffer round

3 years agofix(bkgpslog):Fix incorrect gpsbabel output option for KML file
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 00:18:39 +0000 (00:18 +0000)]
fix(bkgpslog):Fix incorrect gpsbabel output option for KML file

3 years agofeat(bkgpslog):Testing longer buffer and script lifespan
Steven Baltakatei Sandoval [Mon, 29 Jun 2020 00:10:41 +0000 (00:10 +0000)]
feat(bkgpslog):Testing longer buffer and script lifespan

3 years agofeat(bkgpslog):Add GPX KML output from buffer
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 23:53:27 +0000 (23:53 +0000)]
feat(bkgpslog):Add GPX KML output from buffer

3 years agofeat(bkgpslog):Implement buffer for saving gpspipe stream
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 23:36:17 +0000 (23:36 +0000)]
feat(bkgpslog):Implement buffer for saving gpspipe stream

3 years agofeat(bkgpslog):Minor:Add debugCounter to buffer session notif
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 23:21:16 +0000 (23:21 +0000)]
feat(bkgpslog):Minor:Add debugCounter to buffer session notif

3 years agofeat(bkgpslog):Minor debug message for each buffer round
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 23:19:47 +0000 (23:19 +0000)]
feat(bkgpslog):Minor debug message for each buffer round

3 years agofix(bkgpslog):How --output option is parsed
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 23:17:12 +0000 (23:17 +0000)]
fix(bkgpslog):How --output option is parsed

3 years agofix(bkgpslog):Minor checkdir edge case for no argument
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 23:13:14 +0000 (23:13 +0000)]
fix(bkgpslog):Minor checkdir edge case for no argument

3 years agofix(bkgpslog):Apply shellcheck corrections
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 22:57:31 +0000 (22:57 +0000)]
fix(bkgpslog):Apply shellcheck corrections

- Misuse of array and string ("$@" instead of "$*" in error messages)
- Incorrect comparison ( [ "" -eq "" ] instead of [ "" = "" ] )
- Missing quotation marks around string variable.

3 years agofix(bkgpslog):Remove error in how output dir is specified
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 22:38:00 +0000 (22:38 +0000)]
fix(bkgpslog):Remove error in how output dir is specified

3 years agofeat(exec):Add initial draft of pressure logging script
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 20:54:04 +0000 (20:54 +0000)]
feat(exec):Add initial draft of pressure logging script

3 years agofix(bkgpslog):Updated draft of bkgpslog script
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 20:40:12 +0000 (20:40 +0000)]
fix(bkgpslog):Updated draft of bkgpslog script

Added several functions. Script untested.

3 years agofeat(bkgpslog):Add yell, die, try functions
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 16:50:50 +0000 (16:50 +0000)]
feat(bkgpslog):Add yell, die, try functions

3 years agochore(location):Remove date from bkgpslog script
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 16:50:04 +0000 (16:50 +0000)]
chore(location):Remove date from bkgpslog script

3 years agofeat(location):Add script to log gps via Ozzmaker BerryGPS-IMU
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 16:48:11 +0000 (16:48 +0000)]
feat(location):Add script to log gps via Ozzmaker BerryGPS-IMU

3 years agochore(README.md):Add toc to README
Steven Baltakatei Sandoval [Sun, 28 Jun 2020 16:46:01 +0000 (16:46 +0000)]
chore(README.md):Add toc to README

3 years agofeat(README.md) Initial commit
Steven Baltakatei Sandoval [Thu, 11 Jun 2020 06:56:42 +0000 (06:56 +0000)]
feat(README.md) Initial commit

Created README.md describing project.