Daniel Schultz
f8e2c37fe1
kokoro: Generate files during CI runs
...
Signed-off-by: Daniel Schultz <d.schultz@phytec.de>
2021-03-15 17:37:58 +01:00
Keith Rothman
1619b12056
Defer exiting for db-check error until after cleanup.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2021-03-12 08:52:17 -08:00
Daniel Schultz
d258f10c3d
kokoro: Add hostcheck step
...
This step checks the host environment. Right now, it only checks if a drive
is mounted to /tmpfs. If it's not mounted, the run will be aborted and the
dmesg printed.
Signed-off-by: Daniel Schultz <d.schultz@phytec.de>
2021-03-11 20:12:10 +01:00
Keith Rothman
ebc66ac886
Add some disk space checks in happy and sad paths.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2021-03-08 13:05:58 -08:00
Tomasz Michalak
300bc62227
Add licensing header to bash scripts
...
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
Signed-off-by: Tim 'mithro' Ansell <tansell@google.com>
2020-05-26 07:33:12 -07:00
litghost
0fbe443131
Merge pull request #1315 from antmicro/fix_kokoro_tar_packing
...
Fix kokoro tarball packing
2020-04-30 10:09:24 -07:00
Maciej Kurc
a09627a97d
Fixed db-full.sh to correctly pack failed fuzzers to a tar file.
...
Signed-off-by: Maciej Kurc <mkurc@antmicro.com>
2020-04-29 15:44:26 +02:00
Alessandro Comodi
bf87e49e53
kokoro: remove check on failing db gen for extra parts and harness
...
Now that the extra parts and harness files do happen during the full db
generation, the two failing tests are not required anymore
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-04-02 11:29:35 +02:00
Alessandro Comodi
8bed17b40e
htmlgen: add html generation as last step of kokoro
...
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-04-01 20:22:58 +02:00
Keith Rothman
fabae5eb64
Fix some bugs in makefile work tracking.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman
ceb5b2679b
Increase MAX_VIVADO_PROCESS to use more of available memory.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:12 -08:00
Keith Rothman
9f839a7a08
Attempt to parallelize 074 for additional parts.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:34:11 -08:00
Keith Rothman
2bc72b5cce
Increase number of processes allowed to run during final grid reduction.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:33:32 -08:00
Keith Rothman
6129df827f
Increase vivado processes for extra parts.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-19 16:33:32 -08:00
Keith Rothman
0364315e82
Avoid race in 001 fuzzer.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2020-02-18 10:45:26 -08:00
Alessandro Comodi
0e42957c92
enabled multi part generation
...
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-27 18:45:43 +01:00
Alessandro Comodi
5f277c2d30
disable extra-parts generation due to high run-time
...
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:22:37 +01:00
Alessandro Comodi
8d971ea15e
attempt to move extra-parts generation after diff
...
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:13:33 +01:00
Alessandro Comodi
0b623982e5
divided harness and extra parts creation
...
There is an issue with the roi_harness creation, for which the
multi-process make does not correctly works for roi_harness target
Signed-off-by: Alessandro Comodi <acomodi@antmicro.com>
2020-01-24 10:13:33 +01:00
Tim 'mithro' Ansell
ad5caef601
kokoro: Behave better on large diffs.
...
If the diff is very large, don't do a couple of things;
* Output the patch into the console log.
* Generate a pretty HTML version of the diff.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2020-01-23 11:10:27 -08:00
Tomasz Michalak
2e45e534ae
kokoro: Pack failing test cases instead of vivado logs
...
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-06-12 08:47:11 +02:00
Keith Rothman
a4b7207ee3
Ignore errors from diff2html
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-05-30 07:37:54 -07:00
Tomasz Michalak
3f33176cfb
kokoro: Cleanup piplists along with fuzzers
...
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-05-23 15:19:16 +02:00
Tomasz Michalak
77ff259d33
infra: Disable script abort for database generation
...
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-04-18 14:12:50 +02:00
Tomasz Michalak
8794767eca
infra: Collect Vivado logs into tgz archive
...
Signed-off-by: Tomasz Michalak <tmichalak@antmicro.com>
2019-04-18 14:08:46 +02:00
Keith Rothman
36177e9599
Add make targets to build additional outputs from each database.
...
These targets are for:
- Generating additional database outputs that are part, e.g. yaml files.
- Generating harnesses
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-04-10 11:55:39 -07:00
Tim 'mithro' Ansell
822b1af81d
Update the info.md on Kokoro.
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-22 15:16:25 -07:00
Tim 'mithro' Ansell
76b5c1c9ca
Change xxxdb to db-xxx.
...
Makes it work better with tab completion, type db-<tab>
Groups the db related commands together.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-22 15:16:03 -07:00
Tim 'mithro' Ansell
189a5755fc
infra: Don't output color in .patch file
...
(Plus include the stat at the top.)
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 19:29:48 -07:00
Tim 'mithro' Ansell
c9853fbba1
infra: Fix the diff output.
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-03-11 11:40:50 -07:00
Keith Rothman
acf7aafce1
Save fuzzer logs, even on success.
...
Previous CI logic deleted logs files along with intermediate outputs
from fuzzers. This makes debugging issues like #661 harder.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-20 14:36:17 -08:00
Keith Rothman
6e534bc998
Re-enable checkdb now that it isn't slow.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-13 21:23:35 -08:00
Keith Rothman
24f34c7372
Add comment about limiting MAX_VIVADO_INSTANCE to 20.
...
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-08 12:47:31 -08:00
Keith Rothman
820ea7703f
Update CI configuration:
...
- Log output of run_fuzzer.py
- Decrease number of processes running for 072 and 074 to lower memory
load.
Signed-off-by: Keith Rothman <537074+litghost@users.noreply.github.com>
2019-02-08 10:55:35 -08:00
Tim 'mithro' Ansell
98cf09b9df
infra: Improve the diff output.
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-08 10:40:57 +11:00
Tim 'mithro' Ansell
910bc688c3
infra: Working on better diff output.
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
d34c210c1d
infra: Run database download in script.
...
Means the details about the download are captured.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
8d65b6921d
infra: Rework the artifact capture.
...
* Should capture logs / build directory output on failure.
* Should capture the database output on success.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
863621ca14
infra: Disable checkdb.
...
At the moment `make checkdb` seems to get stuck and never finish
sometimes. See issue #583 .
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
c3f6ba5c7c
infra: Detect no changes.
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
5543fc579c
infra: Make sure all fuzzers complete.
...
If they don't output debugging information.
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
c038539f4c
infra: Only formatdb / checkdb for part currently running.
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
655af51539
infra: Run kokoro build inside script.
...
This fixes the issue with make not output status as things run (instead
waiting until a whole command has finished).
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
1991669e8c
infra: Reworking kokoro scripts.
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
e6d737896f
infra: Install pstree
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
bea995b5ea
infra: Output cpu info
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
c8f7480cb8
infra: Remove --output-sync=master
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
d27dfd541a
infra: More aggressive compile.
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00
Tim 'mithro' Ansell
fc1f36f3c0
infra: Restructure.
...
Signed-off-by: Tim 'mithro' Ansell <me@mith.ro>
2019-02-07 21:59:25 +11:00