Commit Graph

138 Commits

Author SHA1 Message Date
Alessandro Comodi b378299ec2 gh: initial use of gh action runners
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2022-02-03 17:23:44 +01:00
Tim 'mithro' Ansell 2f357e8496 Adding connection to a Xilinx license server.
Enables generation of database for larger Kintex parts.

Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2021-12-20 21:51:16 -08:00
Steve f3474a2625 Add support for xc7s50
The previous xc7s50t branch was messed up. This new branch is created to re-submit xc7s50t's changes for merging.

Signed-off-by: Steve <steve.bohan.liu@outlook.com>
2021-12-13 18:39:27 +08:00
Tim 'mithro' Ansell d0f5f4ef58 Delete expired Let's Encrypt certificate.
The old `/usr/share/ca-certificates/mozilla/DST_Root_CA_X3.crt` Let's
Encrypt certificate that has expired.

The "best" solution seems to be to delete the certificate. This is fine
because the new non-expired
`/usr/share/ca-certificates/mozilla/ISRG_Root_X1.crt`
certificate is still available.

See the post at
https://letsencrypt.org/docs/dst-root-ca-x3-expiration-september-2021/
for more explanation.

Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2021-10-01 20:03:04 -07:00
dependabot-preview[bot] 55e529dfef
Upgrade to GitHub-native Dependabot 2021-04-29 19:30:10 +00:00
Alessandro Comodi 865859a5f6 hostcheck: add mount to the output
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2021-03-25 10:55:13 +01:00
Alessandro Comodi 5ca05083d0 hostcheck: increase timeout and fix indentation
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2021-03-25 09:47:42 +01:00
Alessandro Comodi e418f024b9 hostcheck: apply suggestion from comment and replaced tab with spaces
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2021-03-24 18:40:19 +01:00
Daniel Schultz 173bb3b34a kokoro: hostcheck: Add more debug information
Signed-off-by: Daniel Schultz <d.schultz@phytec.de>
2021-03-22 15:22:16 +01:00
Daniel Schultz a6fb88b676 kokoro: hostcheck: Wait 30 seconds at the beginning
The storage device needs a little bit of time to be attached. Wait at the
beginning to make sure the storage device is really not mounted.

Signed-off-by: Daniel Schultz <d.schultz@phytec.de>
2021-03-20 11:08:13 +01:00
Daniel Schultz f8e2c37fe1 kokoro: Generate files during CI runs
Signed-off-by: Daniel Schultz <d.schultz@phytec.de>
2021-03-15 17:37:58 +01:00
Keith Rothman 1619b12056 Defer exiting for db-check error until after cleanup.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2021-03-12 08:52:17 -08:00
Daniel Schultz d258f10c3d kokoro: Add hostcheck step
This step checks the host environment. Right now, it only checks if a drive
is mounted to /tmpfs. If it's not mounted, the run will be aborted and the
dmesg printed.

Signed-off-by: Daniel Schultz <d.schultz@phytec.de>
2021-03-11 20:12:10 +01:00
Keith Rothman ebc66ac886 Add some disk space checks in happy and sad paths.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2021-03-08 13:05:58 -08:00
Keith Rothman f6d97588ee Add dummy spartan7 scripts until spartan7 CI is debugged.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2021-01-13 09:34:35 -08:00
Keith Rothman af6700a692 Limit failure logging to output, but ensure that full logs are available.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-10-09 10:34:44 -07:00
Keith Rothman 8f2456e4bd Output python3 version.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-09-09 11:49:13 -07:00
Keith Rothman c7033a6a19 Clean up python install process.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-09-09 09:48:48 -07:00
Tim 'mithro' Ansell 4d253e00e1 Exclude build directory from check_license.
Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2020-05-26 08:15:06 -07:00
Tim 'mithro' Ansell 072fc6a9d3 travis: Convert the checking stuff to scripts.
Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2020-05-26 07:43:07 -07:00
Tim 'mithro' Ansell e82b22fd6b Adding license header to check_python_scripts.sh
Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2020-05-26 07:36:47 -07:00
Tim 'mithro' Ansell aeb619c1fa Adding license header to check_license.sh script.
Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2020-05-26 07:34:56 -07:00
Tomasz Michalak 631b07b387 Add license check step to Travis
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2020-05-26 07:33:12 -07:00
Tomasz Michalak 300bc62227 Add licensing header to bash scripts
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2020-05-26 07:33:12 -07:00
Tomasz Michalak 93b77925a9 Add licensing header to rest of python scripts
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2020-05-26 07:33:12 -07:00
litghost 0fbe443131
Merge pull request #1315 from antmicro/fix_kokoro_tar_packing
Fix kokoro tarball packing
2020-04-30 10:09:24 -07:00
Maciej Kurc a09627a97d Fixed db-full.sh to correctly pack failed fuzzers to a tar file.
Signed-off-by: Maciej Kurc <mkurc@antmicro.com>
2020-04-29 15:44:26 +02:00
Alessandro Comodi bf87e49e53 kokoro: remove check on failing db gen for extra parts and harness
Now that the extra parts and harness files do happen during the full db
generation, the two failing tests are not required anymore

Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-04-02 11:29:35 +02:00
Alessandro Comodi 8bed17b40e htmlgen: add html generation as last step of kokoro
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-04-01 20:22:58 +02:00
Keith Rothman fabae5eb64 Fix some bugs in makefile work tracking.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman cf463419bf Set MAX_GRID_CPU to increase 074 speed.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman ceb5b2679b Increase MAX_VIVADO_PROCESS to use more of available memory.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman 9f839a7a08 Attempt to parallelize 074 for additional parts.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:11 -08:00
Keith Rothman 2bc72b5cce Increase number of processes allowed to run during final grid reduction.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:33:32 -08:00
Keith Rothman 6129df827f Increase vivado processes for extra parts.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:33:32 -08:00
Keith Rothman 0364315e82 Avoid race in 001 fuzzer.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-18 10:45:26 -08:00
Alessandro Comodi 0e42957c92 enabled multi part generation
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-27 18:45:43 +01:00
Alessandro Comodi 5f277c2d30 disable extra-parts generation due to high run-time
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:22:37 +01:00
Alessandro Comodi 8d971ea15e attempt to move extra-parts generation after diff
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:13:33 +01:00
Alessandro Comodi 0b623982e5 divided harness and extra parts creation
There is an issue with the roi_harness creation, for which the
multi-process make does not correctly works for roi_harness target

Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:13:33 +01:00
Tim 'mithro' Ansell ad5caef601 kokoro: Behave better on large diffs.
If the diff is very large, don't do a couple of things;
 * Output the patch into the console log.
 * Generate a pretty HTML version of the diff.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2020-01-23 11:10:27 -08:00
Tim 'mithro' Ansell 9591007026 kokoro: Update to a newer cmake version.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-12-28 15:11:04 +01:00
Jake Mercer c05b4b0406 MAKE - Format Trailing Whitespace
Add `make format-trailing-ws`.  This recipe finds all _files_ (not
links) known to Git and uses `sed` to remove trailing whitespace.

Signed-off-by: Jake Mercer <jake.mercer@civica.co.uk>
2019-10-26 10:04:52 +01:00
litghost c94cb0224c
Revert "Whitespace" 2019-10-23 14:22:17 -07:00
Jake Mercer bf11f43390 FORMAT - Run `make format`
Changes after running `make format`.  Future commits which add
whitespace should be caught by CI at the PR stage.

Signed-off-by: Jake Mercer <jake.mercer@civica.co.uk>
2019-10-22 19:35:24 +01:00
Tomasz Michalak 2e45e534ae kokoro: Pack failing test cases instead of vivado logs
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-06-12 08:47:11 +02:00
Keith Rothman a4b7207ee3 Ignore errors from diff2html
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-05-30 07:37:54 -07:00
Tomasz Michalak 3f33176cfb kokoro: Cleanup piplists along with fuzzers
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-05-23 15:19:16 +02:00
Tomasz Michalak 77ff259d33 infra: Disable script abort for database generation
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-04-18 14:12:50 +02:00
Tomasz Michalak 8794767eca infra: Collect Vivado logs into tgz archive
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-04-18 14:08:46 +02:00
Keith Rothman 36177e9599 Add make targets to build additional outputs from each database.
These targets are for:
 - Generating additional database outputs that are part, e.g. yaml files.
 - Generating harnesses

Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-04-10 11:55:39 -07:00
Tim 'mithro' Ansell 822b1af81d Update the info.md on Kokoro.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-22 15:16:25 -07:00
Tim 'mithro' Ansell 76b5c1c9ca Change xxxdb to db-xxx.
Makes it work better with tab completion, type db-<tab>
Groups the db related commands together.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-22 15:16:03 -07:00
Tim 'mithro' Ansell 189a5755fc infra: Don't output color in .patch file
(Plus include the stat at the top.)

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 19:29:48 -07:00
Tim 'mithro' Ansell 7d7630e976 infra: Save the .patch file.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 11:46:14 -07:00
Tim 'mithro' Ansell c9853fbba1 infra: Fix the diff output.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 11:40:50 -07:00
Keith Rothman acf7aafce1 Save fuzzer logs, even on success.
Previous CI logic deleted logs files along with intermediate outputs
from fuzzers.  This makes debugging issues like #661 harder.

Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-20 14:36:17 -08:00
Keith Rothman 6e534bc998 Re-enable checkdb now that it isn't slow.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-13 21:23:35 -08:00
Keith Rothman 24f34c7372 Add comment about limiting MAX_VIVADO_INSTANCE to 20.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-08 12:47:31 -08:00
Keith Rothman 820ea7703f Update CI configuration:
- Log output of run_fuzzer.py
 - Decrease number of processes running for 072 and 074 to lower memory
   load.

Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-08 10:55:35 -08:00
Tim 'mithro' Ansell f358b1466f Fixing the autolabeler configuration.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-08 16:09:50 +11:00
Tim Ansell d58cb49121
Merge pull request #625 from mithro/cloudbuild
Cleaning up cloudbuild environment
2019-02-08 15:42:59 +11:00
Tim 'mithro' Ansell 8415f94813 infra: Move cloudbuild under .github directory.
Reduce clutter at top level.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 20:26:09 -08:00
Tim 'mithro' Ansell 98cf09b9df infra: Improve the diff output.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-08 10:40:57 +11:00
Tim 'mithro' Ansell 20ca1ee3aa infra: Remove some stuff in the host setup.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 910bc688c3 infra: Working on better diff output.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell d34c210c1d infra: Run database download in script.
Means the details about the download are captured.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 7412a1b695 infra: Only collect log files for now.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c12d3a02b1 infra: ptybandage wasn't needed in the end.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 8d65b6921d infra: Rework the artifact capture.
* Should capture logs / build directory output on failure.
 * Should capture the database output on success.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 863621ca14 infra: Disable checkdb.
At the moment `make checkdb` seems to get stuck and never finish
sometimes. See issue #583.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c3f6ba5c7c infra: Detect no changes.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 5543fc579c infra: Make sure all fuzzers complete.
If they don't output debugging information.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c038539f4c infra: Only formatdb / checkdb for part currently running.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 655af51539 infra: Run kokoro build inside script.
This fixes the issue with make not output status as things run (instead
waiting until a whole command has finished).

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell fd40839830 infra: Install some custom deb packages.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 1991669e8c infra: Reworking kokoro scripts.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell e6d737896f infra: Install pstree
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell bea995b5ea infra: Output cpu info
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c8f7480cb8 infra: Remove --output-sync=master
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 2d8d4832f1 infra: Remove quick/full split.
Full should be fast enough now.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell d27dfd541a infra: More aggressive compile.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell fc1f36f3c0 infra: Restructure.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 656bbd55c5 infra: Increase timeouts.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 745965d4de infra: Capture test results in Kokoro.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell f7724d9157 infra: Adding kokoro configs.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 88e68414bf Move .update-contributing.py script under .github directory.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-01-10 18:48:48 -08:00
Tim 'mithro' Ansell 6602ae7399 infra: Adding autolabeler configuration.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2018-02-28 14:43:15 -08:00