Skip to content
Snippets Groups Projects

Compare revisions

Changes are shown as if the source revision was being merged into the target revision. Learn more about comparing revisions.

Source

Select target project
No results found
Select Git revision

Target

Select target project
  • wotsubo/PSBoardDataBase
1 result
Select Git revision
Show changes
Commits on Source (14)
Showing
with 179 additions and 104 deletions
docs/build
*.db
*.jld2
......@@ -52,8 +52,6 @@ pages:
- mkdir -p public
- mv docs/build public/dev
- ls docs/src -R
- mkdir -p public/notebooks
- mv docs/src/assets/*.html public/notebooks
artifacts:
paths:
- public
......
......@@ -7,6 +7,24 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
## [Unreleased]
## [1.0.0] - 2025-01-27
### Added
- `create_database`(formally `create_database_from_exported_csvs`) now can save a JLD2 cache to store parsed slave logs.
- Docs: add index page for published notebooks
- Added converter git version info (`git describe --dirty`) and build datetime info to the database and JLD2 cache.
### Changed
- Renamed `create_database_from_exported_csvs` to `create_database` and `create_database` to `create_empty_database`. (!1423)
- Exported `create_database`
- In `DispatchChecker.interactive_dispatch_checker`, printed results are now sorted by runid.
### Deleted
- Extension package for InteractiveUtils
## [0.5.1] - 2025-01-23
### Fixed
......@@ -119,7 +137,8 @@ Release for 6th campaign dispatching.
- Docs on the database and example of querying the database.
- Docs on the internal (Julia implementation)
[unreleased]: https://gitlab.cern.ch/wotsubo/PSBoardDataBase/-/compare/v0.5.1...main
[unreleased]: https://gitlab.cern.ch/wotsubo/PSBoardDataBase/-/compare/v1.0.0...main
[1.0.0]: https://gitlab.cern.ch/wotsubo/PSBoardDataBase/-/compare/v0.5.1...v1.0.0
[0.5.1]: https://gitlab.cern.ch/wotsubo/PSBoardDataBase/-/compare/v0.5.0...v0.5.1
[0.5.0]: https://gitlab.cern.ch/wotsubo/PSBoardDataBase/-/compare/v0.4.0...v0.5.0
[0.4.0]: https://gitlab.cern.ch/wotsubo/PSBoardDataBase/-/compare/v0.3.1...v0.4.0
......
......@@ -2,7 +2,7 @@
julia_version = "1.11.3"
manifest_format = "2.0"
project_hash = "e20af0781afd5866dc7398b8d852e9c8ee3e4f13"
project_hash = "47f0621871082a27225026b076304121300bf44d"
[[deps.ANSIColoredPrinters]]
git-tree-sha1 = "574baf8110975760d391c710b6341da1afa48d8c"
......@@ -118,6 +118,18 @@ git-tree-sha1 = "e51db81749b0777b2147fbe7b783ee79045b8e99"
uuid = "2e619515-83b5-522b-bb60-26c02a35a201"
version = "2.6.4+3"
[[deps.FileIO]]
deps = ["Pkg", "Requires", "UUIDs"]
git-tree-sha1 = "2dd20384bf8c6d411b5c7370865b1e9b26cb2ea3"
uuid = "5789e2e9-d7fb-5bc7-8068-2c6fae9b9549"
version = "1.16.6"
[deps.FileIO.extensions]
HTTPExt = "HTTP"
[deps.FileIO.weakdeps]
HTTP = "cd3eb016-35fb-5094-929b-558a96fad6f3"
[[deps.FilePathsBase]]
deps = ["Compat", "Dates"]
git-tree-sha1 = "7878ff7172a8e6beedd1dea14bd27c3c6340d361"
......@@ -184,6 +196,12 @@ git-tree-sha1 = "a3f24677c21f5bbe9d2a714f95dcd58337fb2856"
uuid = "82899510-4779-5014-852e-03e436cf321d"
version = "1.0.0"
[[deps.JLD2]]
deps = ["FileIO", "MacroTools", "Mmap", "OrderedCollections", "PrecompileTools", "Requires", "TranscodingStreams"]
git-tree-sha1 = "91d501cb908df6f134352ad73cde5efc50138279"
uuid = "033835bb-8acc-5ee8-8aae-3f567f8a3819"
version = "0.5.11"
[[deps.JLLWrappers]]
deps = ["Artifacts", "Preferences"]
git-tree-sha1 = "a007feb38b422fbdab534406aeca1b86823cb4d6"
......@@ -250,6 +268,11 @@ version = "1.11.0"
uuid = "56ddb016-857b-54e1-b83d-db4d58db5568"
version = "1.11.0"
[[deps.MacroTools]]
git-tree-sha1 = "72aebe0b5051e5143a079a4685a46da330a40472"
uuid = "1914dd2f-81c6-5fcd-8719-6d5c9610ff09"
version = "0.5.15"
[[deps.Markdown]]
deps = ["Base64"]
uuid = "d6f4376e-aef5-505a-96c1-9c027394607a"
......@@ -370,6 +393,12 @@ git-tree-sha1 = "ffd19052caf598b8653b99404058fce14828be51"
uuid = "2792f1a3-b283-48e8-9a74-f99dce5104f3"
version = "0.1.0"
[[deps.Requires]]
deps = ["UUIDs"]
git-tree-sha1 = "838a3a4188e2ded87a4f9f184b4b0d78a1e91cb7"
uuid = "ae029012-a4dd-5104-9daa-d747884805df"
version = "1.3.0"
[[deps.SHA]]
uuid = "ea8e919c-243c-51af-8825-aaa63cd721ce"
version = "0.7.0"
......
name = "PSBoardDataBase"
uuid = "779f6a9c-59fa-41f1-8ed1-e9a91eccb2f5"
authors = ["Wataru Otsubo <wotsubo@icepp.s.u-tokyo.ac.jp>"]
version = "0.5.1"
version = "1.0.0"
[deps]
AutoHashEquals = "15f4f7f2-30c1-5605-9d31-71845cf9641f"
......@@ -11,6 +11,7 @@ DataFrames = "a93c6f00-e57d-5684-b7b6-d8193f3e46c0"
Dates = "ade2ca70-3891-5945-98fb-dc099432e06a"
Documenter = "e30172f5-a6a5-5a46-863b-614d45cd2de4"
Downloads = "f43a241f-c20a-4ad4-852c-f6b1247861c6"
JLD2 = "033835bb-8acc-5ee8-8aae-3f567f8a3819"
Printf = "de0858da-6303-5e67-8744-51eddeeeb8d7"
SQLite = "0aa819cd-b072-5ff4-a722-6bc24af294d9"
StaticArrays = "90137ffa-7385-5640-81b9-e52037218182"
......@@ -20,7 +21,6 @@ Tables = "bd369af6-aec1-5ad0-b16a-f7cc5008161c"
InteractiveUtils = "b77e0a4c-d291-57a0-90e8-8db25a27a240"
[extensions]
PSBoardDataBaseInteractiveUtilsExt = "InteractiveUtils"
[compat]
Aqua = "0.8"
......@@ -32,6 +32,7 @@ Dates = "1.10"
Documenter = "1.7"
Downloads = "1"
InteractiveUtils = "1.10"
JLD2 = "0.5.11"
Printf = "1.10"
SQLite = "1"
StaticArrays = "1.9"
......
......@@ -9,7 +9,4 @@ PS Boardに関する(特にQAQCの結果に関する)データベース。
PS Board QAQCに関しては[こちら](https://gitlab.cern.ch/dhashimo/PS_Board_QAQC)
解析結果の例
- 結果一覧閲覧用簡易アプリケーション: https://psboard-database.docs.cern.ch/notebooks/get_results.html
- skewに関する統計調査: https://psboard-database.docs.cern.ch/notebooks/skew_stats.html
- power試験に関する統計: https://psboard-database.docs.cern.ch/notebooks/power_stats.html
解析結果の例は[notebooks](https://psboard-database.docs.cern.ch/dev/notebooks)を参照。
......@@ -136,6 +136,18 @@ git-tree-sha1 = "e51db81749b0777b2147fbe7b783ee79045b8e99"
uuid = "2e619515-83b5-522b-bb60-26c02a35a201"
version = "2.6.4+3"
[[deps.FileIO]]
deps = ["Pkg", "Requires", "UUIDs"]
git-tree-sha1 = "2dd20384bf8c6d411b5c7370865b1e9b26cb2ea3"
uuid = "5789e2e9-d7fb-5bc7-8068-2c6fae9b9549"
version = "1.16.6"
[deps.FileIO.extensions]
HTTPExt = "HTTP"
[deps.FileIO.weakdeps]
HTTP = "cd3eb016-35fb-5094-929b-558a96fad6f3"
[[deps.FilePathsBase]]
deps = ["Compat", "Dates"]
git-tree-sha1 = "7878ff7172a8e6beedd1dea14bd27c3c6340d361"
......@@ -202,6 +214,12 @@ git-tree-sha1 = "a3f24677c21f5bbe9d2a714f95dcd58337fb2856"
uuid = "82899510-4779-5014-852e-03e436cf321d"
version = "1.0.0"
[[deps.JLD2]]
deps = ["FileIO", "MacroTools", "Mmap", "OrderedCollections", "PrecompileTools", "Requires", "TranscodingStreams"]
git-tree-sha1 = "91d501cb908df6f134352ad73cde5efc50138279"
uuid = "033835bb-8acc-5ee8-8aae-3f567f8a3819"
version = "0.5.11"
[[deps.JLLWrappers]]
deps = ["Artifacts", "Preferences"]
git-tree-sha1 = "a007feb38b422fbdab534406aeca1b86823cb4d6"
......@@ -268,6 +286,11 @@ version = "1.11.0"
uuid = "56ddb016-857b-54e1-b83d-db4d58db5568"
version = "1.11.0"
[[deps.MacroTools]]
git-tree-sha1 = "72aebe0b5051e5143a079a4685a46da330a40472"
uuid = "1914dd2f-81c6-5fcd-8719-6d5c9610ff09"
version = "0.5.15"
[[deps.Markdown]]
deps = ["Base64"]
uuid = "d6f4376e-aef5-505a-96c1-9c027394607a"
......@@ -324,15 +347,12 @@ uuid = "efcefdf7-47ab-520b-bdef-62a2eaa19f15"
version = "10.42.0+1"
[[deps.PSBoardDataBase]]
deps = ["AutoHashEquals", "CSV", "DBInterface", "DataFrames", "Dates", "Documenter", "Downloads", "Printf", "SQLite", "StaticArrays", "Tables"]
deps = ["AutoHashEquals", "CSV", "DBInterface", "DataFrames", "Dates", "Documenter", "Downloads", "JLD2", "Printf", "SQLite", "StaticArrays", "Tables"]
path = "/home/qwjyh/Documents/school/lab/PSBoard_QAQC/PSBoardDataBase"
uuid = "779f6a9c-59fa-41f1-8ed1-e9a91eccb2f5"
version = "0.5.0"
version = "1.0.0"
weakdeps = ["InteractiveUtils"]
[deps.PSBoardDataBase.extensions]
PSBoardDataBaseInteractiveUtilsExt = "InteractiveUtils"
[[deps.Parsers]]
deps = ["Dates", "PrecompileTools", "UUIDs"]
git-tree-sha1 = "8489905bcdbcfac64d1daa51ca07c0d8f0283821"
......@@ -398,6 +418,12 @@ git-tree-sha1 = "ffd19052caf598b8653b99404058fce14828be51"
uuid = "2792f1a3-b283-48e8-9a74-f99dce5104f3"
version = "0.1.0"
[[deps.Requires]]
deps = ["UUIDs"]
git-tree-sha1 = "838a3a4188e2ded87a4f9f184b4b0d78a1e91cb7"
uuid = "ae029012-a4dd-5104-9daa-d747884805df"
version = "1.3.0"
[[deps.SHA]]
uuid = "ea8e919c-243c-51af-8825-aaa63cd721ce"
version = "0.7.0"
......
using Documenter, PSBoardDataBase
using DocumenterInterLinks
include("./make_notebook_index.jl")
DocMeta.setdocmeta!(
PSBoardDataBase,
:DocTestSetup,
......
using Markdown
cd(dirname(@__FILE__))
cd("src/notebooks/") do
contents =
map(readdir() |> filter(!=(".gitignore")) |> filter(!=("index.html"))) do file
"- [`$file`]($file)"
end |> (v -> join(v, '\n'))
index_content = Markdown.parse("""
# notebooks
$(contents)
""")
open("index.html", "w") do f
show(f, MIME"text/html"(), index_content)
end
end
......@@ -12,13 +12,13 @@ Depth = 4
# このリポジトリのソフトウェアについての説明
このリポジトリにあるのは、JATHub masterのログファイル、及びGoogle SheetsからエクスポートしたCSVファイルからデータベースを作成するためのコードである。
メインの関数は[`create_database_from_exported_csvs`](@ref)である。
メインの関数は[`create_database`](@ref)である。
!!! info
**TLDR**;
データベースがほしいときは_Masterのログ_と_Slaveのログ_を用意して、[`create_database_from_exported_csvs`](@ref)
データベースがほしいときは_Masterのログ_と_Slaveのログ_を用意して、[`create_database`](@ref)
```julia
create_database_from_exported_csvs(
create_database(
"database_name.db";
masterlog_dir = "dir/to/master/logs",
slavelog_dir = "dir/to/slave/logs"
......@@ -39,7 +39,7 @@ backspaceでjulianモードに戻り(左側が`julia>`になってる)、`using
`?`を押すとhelpモードに入り、関数名などをいれるとそのドキュメント(下にあるものと同じ)が閲覧できる。
`PSBoardDataBase.create_database_from_exported_csvs`を検索すると使い方がわかる。
`PSBoardDataBase.create_database`を検索すると使い方がわかる。
# テストについて
......
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
index.html
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.