Commit Graph

45 Commits

Author SHA1 Message Date
Tomasz Michalak 300bc62227 Add licensing header to bash scripts
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2020-05-26 07:33:12 -07:00
litghost 0fbe443131
Merge pull request #1315 from antmicro/fix_kokoro_tar_packing
Fix kokoro tarball packing
2020-04-30 10:09:24 -07:00
Maciej Kurc a09627a97d Fixed db-full.sh to correctly pack failed fuzzers to a tar file.
Signed-off-by: Maciej Kurc <mkurc@antmicro.com>
2020-04-29 15:44:26 +02:00
Alessandro Comodi bf87e49e53 kokoro: remove check on failing db gen for extra parts and harness
Now that the extra parts and harness files do happen during the full db
generation, the two failing tests are not required anymore

Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-04-02 11:29:35 +02:00
Alessandro Comodi 8bed17b40e htmlgen: add html generation as last step of kokoro
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-04-01 20:22:58 +02:00
Keith Rothman fabae5eb64 Fix some bugs in makefile work tracking.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman ceb5b2679b Increase MAX_VIVADO_PROCESS to use more of available memory.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman 9f839a7a08 Attempt to parallelize 074 for additional parts.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:11 -08:00
Keith Rothman 2bc72b5cce Increase number of processes allowed to run during final grid reduction.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:33:32 -08:00
Keith Rothman 6129df827f Increase vivado processes for extra parts.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:33:32 -08:00
Keith Rothman 0364315e82 Avoid race in 001 fuzzer.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-18 10:45:26 -08:00
Alessandro Comodi 0e42957c92 enabled multi part generation
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-27 18:45:43 +01:00
Alessandro Comodi 5f277c2d30 disable extra-parts generation due to high run-time
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:22:37 +01:00
Alessandro Comodi 8d971ea15e attempt to move extra-parts generation after diff
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:13:33 +01:00
Alessandro Comodi 0b623982e5 divided harness and extra parts creation
There is an issue with the roi_harness creation, for which the
multi-process make does not correctly works for roi_harness target

Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:13:33 +01:00
Tim 'mithro' Ansell ad5caef601 kokoro: Behave better on large diffs.
If the diff is very large, don't do a couple of things;
 * Output the patch into the console log.
 * Generate a pretty HTML version of the diff.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2020-01-23 11:10:27 -08:00
Tomasz Michalak 2e45e534ae kokoro: Pack failing test cases instead of vivado logs
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-06-12 08:47:11 +02:00
Keith Rothman a4b7207ee3 Ignore errors from diff2html
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-05-30 07:37:54 -07:00
Tomasz Michalak 3f33176cfb kokoro: Cleanup piplists along with fuzzers
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-05-23 15:19:16 +02:00
Tomasz Michalak 77ff259d33 infra: Disable script abort for database generation
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-04-18 14:12:50 +02:00
Tomasz Michalak 8794767eca infra: Collect Vivado logs into tgz archive
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-04-18 14:08:46 +02:00
Keith Rothman 36177e9599 Add make targets to build additional outputs from each database.
These targets are for:
 - Generating additional database outputs that are part, e.g. yaml files.
 - Generating harnesses

Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-04-10 11:55:39 -07:00
Tim 'mithro' Ansell 822b1af81d Update the info.md on Kokoro.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-22 15:16:25 -07:00
Tim 'mithro' Ansell 76b5c1c9ca Change xxxdb to db-xxx.
Makes it work better with tab completion, type db-<tab>
Groups the db related commands together.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-22 15:16:03 -07:00
Tim 'mithro' Ansell 189a5755fc infra: Don't output color in .patch file
(Plus include the stat at the top.)

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 19:29:48 -07:00
Tim 'mithro' Ansell c9853fbba1 infra: Fix the diff output.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 11:40:50 -07:00
Keith Rothman acf7aafce1 Save fuzzer logs, even on success.
Previous CI logic deleted logs files along with intermediate outputs
from fuzzers.  This makes debugging issues like #661 harder.

Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-20 14:36:17 -08:00
Keith Rothman 6e534bc998 Re-enable checkdb now that it isn't slow.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-13 21:23:35 -08:00
Keith Rothman 24f34c7372 Add comment about limiting MAX_VIVADO_INSTANCE to 20.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-08 12:47:31 -08:00
Keith Rothman 820ea7703f Update CI configuration:
- Log output of run_fuzzer.py
 - Decrease number of processes running for 072 and 074 to lower memory
   load.

Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-08 10:55:35 -08:00
Tim 'mithro' Ansell 98cf09b9df infra: Improve the diff output.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-08 10:40:57 +11:00
Tim 'mithro' Ansell 910bc688c3 infra: Working on better diff output.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell d34c210c1d infra: Run database download in script.
Means the details about the download are captured.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 8d65b6921d infra: Rework the artifact capture.
* Should capture logs / build directory output on failure.
 * Should capture the database output on success.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 863621ca14 infra: Disable checkdb.
At the moment `make checkdb` seems to get stuck and never finish
sometimes. See issue #583.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c3f6ba5c7c infra: Detect no changes.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 5543fc579c infra: Make sure all fuzzers complete.
If they don't output debugging information.

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c038539f4c infra: Only formatdb / checkdb for part currently running.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 655af51539 infra: Run kokoro build inside script.
This fixes the issue with make not output status as things run (instead
waiting until a whole command has finished).

Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell 1991669e8c infra: Reworking kokoro scripts.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell e6d737896f infra: Install pstree
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell bea995b5ea infra: Output cpu info
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell c8f7480cb8 infra: Remove --output-sync=master
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell d27dfd541a infra: More aggressive compile.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell fc1f36f3c0 infra: Restructure.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00