Skip to content

Commit

Permalink
Nikola auto commit.
Browse files Browse the repository at this point in the history
Source commit: 77f18df
Nikola version: 8.3.1
  • Loading branch information
Unknown committed Jul 1, 2024
1 parent 300acf7 commit 37807c4
Show file tree
Hide file tree
Showing 20 changed files with 461 additions and 192 deletions.
3 changes: 3 additions & 0 deletions 2024/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -83,6 +83,9 @@
<article class="listpage"><header><h1>Posts for year 2024</h1>
</header><ul class="postlist">
<li>
<time class="listdate" datetime="2024-07-02T09:56:00+12:00" title="2024-07-02 09:56">2024-07-02 09:56</time><a href="../news/2024-07-02-idc-release/" class="listtitle">image-dataset-converter release</a>
</li>
<li>
<time class="listdate" datetime="2024-06-18T16:51:00+12:00" title="2024-06-18 16:51">2024-06-18 16:51</time><a href="../news/2024-06-18-fast-opex/" class="listtitle">fast-opex released</a>
</li>
<li>
Expand Down
2 changes: 1 addition & 1 deletion archive.html
Original file line number Diff line number Diff line change
Expand Up @@ -84,7 +84,7 @@
</header><ul class="postlist">
<li>
<a href="2024/">2024</a>
(8)
(9)
</li>
<li>
<a href="2023/">2023</a>
Expand Down
2 changes: 1 addition & 1 deletion categories/cat_docker.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<?xml-stylesheet type="text/xsl" href="../assets/xml/rss.xsl" media="all"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Data mining (Posts about docker)</title><link>https://www.data-mining.co.nz/</link><description></description><atom:link href="https://www.data-mining.co.nz/categories/cat_docker.xml" rel="self" type="application/rss+xml"></atom:link><language>en</language><copyright>Contents © 2024 &lt;a href="mailto:[email protected]"&gt;University of Waikato&lt;/a&gt; </copyright><lastBuildDate>Tue, 18 Jun 2024 05:01:28 GMT</lastBuildDate><generator>Nikola (getnikola.com)</generator><docs>http://blogs.law.harvard.edu/tech/rss</docs><item><title>Faster Whisper 1.0.2 (speech-to-text)</title><link>https://www.data-mining.co.nz/news/2024-05-28-faster-whisper/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;New Docker images are now available for speech-to-text using &lt;a class="reference external" href="https://github.com/SYSTRAN/faster-whisper"&gt;Faster Whisper&lt;/a&gt; 1.0.2:&lt;/p&gt;
<?xml-stylesheet type="text/xsl" href="../assets/xml/rss.xsl" media="all"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Data mining (Posts about docker)</title><link>https://www.data-mining.co.nz/</link><description></description><atom:link href="https://www.data-mining.co.nz/categories/cat_docker.xml" rel="self" type="application/rss+xml"></atom:link><language>en</language><copyright>Contents © 2024 &lt;a href="mailto:[email protected]"&gt;University of Waikato&lt;/a&gt; </copyright><lastBuildDate>Mon, 01 Jul 2024 22:10:32 GMT</lastBuildDate><generator>Nikola (getnikola.com)</generator><docs>http://blogs.law.harvard.edu/tech/rss</docs><item><title>Faster Whisper 1.0.2 (speech-to-text)</title><link>https://www.data-mining.co.nz/news/2024-05-28-faster-whisper/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;New Docker images are now available for speech-to-text using &lt;a class="reference external" href="https://github.com/SYSTRAN/faster-whisper"&gt;Faster Whisper&lt;/a&gt; 1.0.2:&lt;/p&gt;
&lt;p&gt;&lt;a class="reference external" href="https://github.com/waikato-llm/whisper/tree/main/faster-whisper-1.0.2_cuda12.1"&gt;https://github.com/waikato-llm/whisper/tree/main/faster-whisper-1.0.2_cuda12.1&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;&lt;a class="reference external" href="https://github.com/waikato-llm/whisper/tree/main/faster-whisper-1.0.2_cpu"&gt;https://github.com/waikato-llm/whisper/tree/main/faster-whisper-1.0.2_cpu&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;Faster Whisper is a reimplementation of OpenAI's Whisper library with some &lt;a class="reference external" href="https://github.com/SYSTRAN/faster-whisper#benchmark"&gt;dramatic speed ups&lt;/a&gt;.&lt;/p&gt;
Expand Down
2 changes: 1 addition & 1 deletion categories/cat_library.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<?xml-stylesheet type="text/xsl" href="../assets/xml/rss.xsl" media="all"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Data mining (Posts about library)</title><link>https://www.data-mining.co.nz/</link><description></description><atom:link href="https://www.data-mining.co.nz/categories/cat_library.xml" rel="self" type="application/rss+xml"></atom:link><language>en</language><copyright>Contents © 2024 &lt;a href="mailto:[email protected]"&gt;University of Waikato&lt;/a&gt; </copyright><lastBuildDate>Tue, 18 Jun 2024 05:01:28 GMT</lastBuildDate><generator>Nikola (getnikola.com)</generator><docs>http://blogs.law.harvard.edu/tech/rss</docs><item><title>video-frame-selector library released</title><link>https://www.data-mining.co.nz/news/2021-11-02-video-frame-selector/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;Release 0.0.8 of the &lt;strong&gt;video-frame-selector&lt;/strong&gt; Python 3 library is now available:&lt;/p&gt;
<?xml-stylesheet type="text/xsl" href="../assets/xml/rss.xsl" media="all"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Data mining (Posts about library)</title><link>https://www.data-mining.co.nz/</link><description></description><atom:link href="https://www.data-mining.co.nz/categories/cat_library.xml" rel="self" type="application/rss+xml"></atom:link><language>en</language><copyright>Contents © 2024 &lt;a href="mailto:[email protected]"&gt;University of Waikato&lt;/a&gt; </copyright><lastBuildDate>Mon, 01 Jul 2024 22:10:31 GMT</lastBuildDate><generator>Nikola (getnikola.com)</generator><docs>http://blogs.law.harvard.edu/tech/rss</docs><item><title>video-frame-selector library released</title><link>https://www.data-mining.co.nz/news/2021-11-02-video-frame-selector/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;Release 0.0.8 of the &lt;strong&gt;video-frame-selector&lt;/strong&gt; Python 3 library is now available:&lt;/p&gt;
&lt;p&gt;&lt;a class="reference external" href="https://github.com/waikato-datamining/video-frame-selector"&gt;github.com/waikato-datamining/video-frame-selector&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;It includes some bug-fixes relating to the the Redis support and it now can
iterate over images in a directory as well (not just processing video or webcam feed).&lt;/p&gt;</description><category>release</category><guid>https://www.data-mining.co.nz/news/2021-11-02-video-frame-selector/</guid><pubDate>Tue, 02 Nov 2021 00:55:00 GMT</pubDate></item><item><title>tflite model maker tools</title><link>https://www.data-mining.co.nz/news/2021-10-06-tflite-model-maker/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;Tensorflow made the &lt;a class="reference external" href="https://www.tensorflow.org/lite/guide/model_maker"&gt;tflite model maker&lt;/a&gt; available a while go,
Expand Down
25 changes: 24 additions & 1 deletion categories/cat_software.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,28 @@
<?xml version="1.0" encoding="utf-8"?>
<?xml-stylesheet type="text/xsl" href="../assets/xml/rss.xsl" media="all"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Data mining (Posts about software)</title><link>https://www.data-mining.co.nz/</link><description></description><atom:link href="https://www.data-mining.co.nz/categories/cat_software.xml" rel="self" type="application/rss+xml"></atom:link><language>en</language><copyright>Contents © 2024 &lt;a href="mailto:[email protected]"&gt;University of Waikato&lt;/a&gt; </copyright><lastBuildDate>Tue, 18 Jun 2024 05:01:28 GMT</lastBuildDate><generator>Nikola (getnikola.com)</generator><docs>http://blogs.law.harvard.edu/tech/rss</docs><item><title>fast-opex released</title><link>https://www.data-mining.co.nz/news/2024-06-18-fast-opex/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;The OPEX (&lt;a class="reference external" href="https://github.com/WaikatoLink2020/objdet-predictions-exchange-format"&gt;Object Predictions EXchange&lt;/a&gt;)
<?xml-stylesheet type="text/xsl" href="../assets/xml/rss.xsl" media="all"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Data mining (Posts about software)</title><link>https://www.data-mining.co.nz/</link><description></description><atom:link href="https://www.data-mining.co.nz/categories/cat_software.xml" rel="self" type="application/rss+xml"></atom:link><language>en</language><copyright>Contents © 2024 &lt;a href="mailto:[email protected]"&gt;University of Waikato&lt;/a&gt; </copyright><lastBuildDate>Mon, 01 Jul 2024 22:10:32 GMT</lastBuildDate><generator>Nikola (getnikola.com)</generator><docs>http://blogs.law.harvard.edu/tech/rss</docs><item><title>image-dataset-converter release</title><link>https://www.data-mining.co.nz/news/2024-07-02-idc-release/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;Out &lt;a class="reference external" href="https://github.com/waikato-datamining/image-dataset-converter"&gt;image-dataset-converter&lt;/a&gt; library keeps evolving
and, apart from fixing bugs, we also keep adding useful stuff.&lt;/p&gt;
&lt;p&gt;The version of the &lt;cite&gt;image-dataset-converter-all&lt;/cite&gt; library stands now at &lt;strong&gt;0.0.3&lt;/strong&gt;.&lt;/p&gt;
&lt;p&gt;Since version 0.0.2 the following changes occurred:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;p&gt;image-dataset-converter (core library):&lt;/p&gt;
&lt;blockquote&gt;
&lt;ul class="simple"&gt;
&lt;li&gt;&lt;p&gt;switched to the &lt;cite&gt;fast-opex&lt;/cite&gt; library&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;helper method &lt;cite&gt;from_indexedpng&lt;/cite&gt; was using incorrect label index (off by 1)&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;cite&gt;Data.save_image&lt;/cite&gt; method now ensures that source/target files exist before calling &lt;cite&gt;os.path.samefile&lt;/cite&gt;&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;requiring seppl&amp;gt;=0.2.6 now&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;readers now support default globs, allowing the user to just specify directories as input (and the default glob gets appended)&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;the &lt;cite&gt;to-yolo-od&lt;/cite&gt; writer now has an option for predefined labels (for enforcing label order)&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;the &lt;cite&gt;to-yolo-od&lt;/cite&gt; writer now stores the labels/labels_cvs files in the respective output folders rather than using an absolute file name&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;the bluechannel/grayscale/indexed-png image segmentation readers/writers can use a value other than 0 now for the background&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;cite&gt;split&lt;/cite&gt; filter has been renamed to &lt;cite&gt;split-records&lt;/cite&gt;&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/blockquote&gt;
&lt;/li&gt;
&lt;li&gt;&lt;p&gt;image-dataset-converter-imgaug: added &lt;cite&gt;find-contours&lt;/cite&gt; filter for turning blobs in image segmentation annotations into object detection polygons.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;image-dataset-converter-imgvis: added &lt;cite&gt;add-center-overlay-od&lt;/cite&gt; overlay filter&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;image-dataset-converter-pdf (new module): adds support for PDF, like extracting images from PDF and compiling PDF from images&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;</description><category>release</category><guid>https://www.data-mining.co.nz/news/2024-07-02-idc-release/</guid><pubDate>Mon, 01 Jul 2024 21:56:00 GMT</pubDate></item><item><title>fast-opex released</title><link>https://www.data-mining.co.nz/news/2024-06-18-fast-opex/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;The OPEX (&lt;a class="reference external" href="https://github.com/WaikatoLink2020/objdet-predictions-exchange-format"&gt;Object Predictions EXchange&lt;/a&gt;)
format features heavily in our docker images for storing/broadcasting predictions. However, last week I noticed
that it incurs quite a significant speed penalty due to its use of JSON schema under the hood.
Since we want to be as fast as possible at prediction time, I sat down and rewrote the library using very basic
Expand Down
3 changes: 3 additions & 0 deletions categories/cat_software/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,9 @@

</header><ul class="postlist">
<li>
<time class="listdate" datetime="2024-07-02T09:56:00+12:00" title="2024-07-02 09:56">2024-07-02 09:56</time><a href="../../news/2024-07-02-idc-release/" class="listtitle">image-dataset-converter release</a><a></a>
</li>
<li>
<time class="listdate" datetime="2024-06-18T16:51:00+12:00" title="2024-06-18 16:51">2024-06-18 16:51</time><a href="../../news/2024-06-18-fast-opex/" class="listtitle">fast-opex released</a><a></a>
</li>
<li>
Expand Down
2 changes: 1 addition & 1 deletion categories/github.xml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<?xml version="1.0" encoding="utf-8"?>
<?xml-stylesheet type="text/xsl" href="../assets/xml/rss.xsl" media="all"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Data mining (Posts about github)</title><link>https://www.data-mining.co.nz/</link><description></description><atom:link href="https://www.data-mining.co.nz/categories/github.xml" rel="self" type="application/rss+xml"></atom:link><language>en</language><copyright>Contents © 2024 &lt;a href="mailto:[email protected]"&gt;University of Waikato&lt;/a&gt; </copyright><lastBuildDate>Tue, 18 Jun 2024 05:01:28 GMT</lastBuildDate><generator>Nikola (getnikola.com)</generator><docs>http://blogs.law.harvard.edu/tech/rss</docs><item><title>LLM organization on Github</title><link>https://www.data-mining.co.nz/news/2023-10-19-llm-on-github/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;We have launched a new Github organization to house all our libraries and Docker images around
<?xml-stylesheet type="text/xsl" href="../assets/xml/rss.xsl" media="all"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Data mining (Posts about github)</title><link>https://www.data-mining.co.nz/</link><description></description><atom:link href="https://www.data-mining.co.nz/categories/github.xml" rel="self" type="application/rss+xml"></atom:link><language>en</language><copyright>Contents © 2024 &lt;a href="mailto:[email protected]"&gt;University of Waikato&lt;/a&gt; </copyright><lastBuildDate>Mon, 01 Jul 2024 22:10:31 GMT</lastBuildDate><generator>Nikola (getnikola.com)</generator><docs>http://blogs.law.harvard.edu/tech/rss</docs><item><title>LLM organization on Github</title><link>https://www.data-mining.co.nz/news/2023-10-19-llm-on-github/</link><dc:creator>University of Waikato</dc:creator><description>&lt;p&gt;We have launched a new Github organization to house all our libraries and Docker images around
large language models (LLMs):&lt;/p&gt;
&lt;p&gt;&lt;a class="reference external" href="https://github.com/waikato-llm"&gt;https://github.com/waikato-llm&lt;/a&gt;&lt;/p&gt;</description><category>github</category><guid>https://www.data-mining.co.nz/news/2023-10-19-llm-on-github/</guid><pubDate>Wed, 18 Oct 2023 21:56:00 GMT</pubDate></item></channel></rss>
Loading

0 comments on commit 37807c4

Please sign in to comment.