Commit Graph

59 Commits

Author SHA1 Message Date
Keith Rothman fabae5eb64 Fix some bugs in makefile work tracking.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman cf463419bf Set MAX_GRID_CPU to increase 074 speed.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman ceb5b2679b Increase MAX_VIVADO_PROCESS to use more of available memory.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman 9f839a7a08 Attempt to parallelize 074 for additional parts.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:11 -08:00
Keith Rothman 2bc72b5cce Increase number of processes allowed to run during final grid reduction.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:33:32 -08:00
Keith Rothman 6129df827f Increase vivado processes for extra parts.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:33:32 -08:00
Keith Rothman 0364315e82 Avoid race in 001 fuzzer.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-18 10:45:26 -08:00
Alessandro Comodi 0e42957c92 enabled multi part generation
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-27 18:45:43 +01:00
Alessandro Comodi 5f277c2d30 disable extra-parts generation due to high run-time
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:22:37 +01:00
Alessandro Comodi 8d971ea15e attempt to move extra-parts generation after diff
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:13:33 +01:00
Alessandro Comodi 0b623982e5 divided harness and extra parts creation
There is an issue with the roi_harness creation, for which the
multi-process make does not correctly works for roi_harness target

Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:13:33 +01:00
Tim 'mithro' Ansell ad5caef601 kokoro: Behave better on large diffs.
If the diff is very large, don't do a couple of things;
 * Output the patch into the console log.
 * Generate a pretty HTML version of the diff.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2020-01-23 11:10:27 -08:00
Tim 'mithro' Ansell 9591007026 kokoro: Update to a newer cmake version.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-12-28 15:11:04 +01:00
Jake Mercer c05b4b0406 MAKE - Format Trailing Whitespace
Add `make format-trailing-ws`.  This recipe finds all _files_ (not
links) known to Git and uses `sed` to remove trailing whitespace.

Signed-off-by: Jake Mercer <jake.mercer@civica.co.uk>
2019-10-26 10:04:52 +01:00
litghost c94cb0224c
Revert "Whitespace" 2019-10-23 14:22:17 -07:00
Jake Mercer bf11f43390 FORMAT - Run `make format`
Changes after running `make format`.  Future commits which add
whitespace should be caught by CI at the PR stage.

Signed-off-by: Jake Mercer <jake.mercer@civica.co.uk>
2019-10-22 19:35:24 +01:00
Tomasz Michalak 2e45e534ae kokoro: Pack failing test cases instead of vivado logs
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-06-12 08:47:11 +02:00
Keith Rothman a4b7207ee3 Ignore errors from diff2html
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-05-30 07:37:54 -07:00
Tomasz Michalak 3f33176cfb kokoro: Cleanup piplists along with fuzzers
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-05-23 15:19:16 +02:00
Tomasz Michalak 77ff259d33 infra: Disable script abort for database generation
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-04-18 14:12:50 +02:00
Tomasz Michalak 8794767eca infra: Collect Vivado logs into tgz archive
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-04-18 14:08:46 +02:00
Keith Rothman 36177e9599 Add make targets to build additional outputs from each database.
These targets are for:
 - Generating additional database outputs that are part, e.g. yaml files.
 - Generating harnesses

Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-04-10 11:55:39 -07:00
Tim 'mithro' Ansell 822b1af81d Update the info.md on Kokoro.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-22 15:16:25 -07:00
Tim 'mithro' Ansell 76b5c1c9ca Change xxxdb to db-xxx.
Makes it work better with tab completion, type db-<tab>
Groups the db related commands together.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-22 15:16:03 -07:00
Tim 'mithro' Ansell 189a5755fc infra: Don't output color in .patch file
(Plus include the stat at the top.)

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 19:29:48 -07:00
Tim 'mithro' Ansell 7d7630e976 infra: Save the .patch file.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 11:46:14 -07:00
Tim 'mithro' Ansell c9853fbba1 infra: Fix the diff output.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 11:40:50 -07:00
Keith Rothman acf7aafce1 Save fuzzer logs, even on success.
Previous CI logic deleted logs files along with intermediate outputs
from fuzzers.  This makes debugging issues like #661 harder.

Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-20 14:36:17 -08:00
Keith Rothman 6e534bc998 Re-enable checkdb now that it isn't slow.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-13 21:23:35 -08:00
Keith Rothman 24f34c7372 Add comment about limiting MAX_VIVADO_INSTANCE to 20.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-08 12:47:31 -08:00
Keith Rothman 820ea7703f Update CI configuration:
- Log output of run_fuzzer.py
 - Decrease number of processes running for 072 and 074 to lower memory
   load.

Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-08 10:55:35 -08:00
Tim 'mithro' Ansell f358b1466f Fixing the autolabeler configuration.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-08 16:09:50 +11:00
Tim Ansell d58cb49121
Merge pull request #625 from mithro/cloudbuild
Cleaning up cloudbuild environment
2019-02-08 15:42:59 +11:00
Tim 'mithro' Ansell 8415f94813 infra: Move cloudbuild under .github directory.
Reduce clutter at top level.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 20:26:09 -08:00
Tim 'mithro' Ansell 98cf09b9df infra: Improve the diff output.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-08 10:40:57 +11:00
Tim 'mithro' Ansell 20ca1ee3aa infra: Remove some stuff in the host setup.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 910bc688c3 infra: Working on better diff output.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell d34c210c1d infra: Run database download in script.
Means the details about the download are captured.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 7412a1b695 infra: Only collect log files for now.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c12d3a02b1 infra: ptybandage wasn't needed in the end.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 8d65b6921d infra: Rework the artifact capture.
* Should capture logs / build directory output on failure.
 * Should capture the database output on success.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 863621ca14 infra: Disable checkdb.
At the moment `make checkdb` seems to get stuck and never finish
sometimes. See issue #583.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c3f6ba5c7c infra: Detect no changes.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 5543fc579c infra: Make sure all fuzzers complete.
If they don't output debugging information.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c038539f4c infra: Only formatdb / checkdb for part currently running.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 655af51539 infra: Run kokoro build inside script.
This fixes the issue with make not output status as things run (instead
waiting until a whole command has finished).

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell fd40839830 infra: Install some custom deb packages.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 1991669e8c infra: Reworking kokoro scripts.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell e6d737896f infra: Install pstree
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell bea995b5ea infra: Output cpu info
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00