Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 3.0 #10

Open
wants to merge 61 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
61 commits
Select commit Hold shift + click to select a range
8b975dc
Preparation of executeSPARQL method + mappingFromIndexFieldToPropertyURL
Dec 3, 2018
63b28b5
First try to request infos from identity service
Dec 12, 2018
7c371d3
add test source code to trigger the identity service
Dec 12, 2018
0588b2d
Preparation to get the userId by the UI.
Dec 13, 2018
e143b86
Check whether Indexing Service can be integrated -> Yes
Jan 23, 2019
f99d146
Feature: detectMeaning, getPropertiesIncludingEverything, getLogicalView
Jan 31, 2019
d371f54
First try: getDifferentValuesOfConcept from items
Feb 11, 2019
b04a2f3
Feature: getOptionalSPARQLSelect works but slow
Feb 12, 2019
af7359b
Preparation fo filter possible property filter for the user.
Feb 14, 2019
94e4303
intermediate state for executeSPARQL result. Mapping is unclear
marcofranke May 2, 2019
e6b46f4
add UBL properties as default props for each concept
May 16, 2019
bbfa6cc
Create standard properties like name, description in Java
May 16, 2019
4a4db6f
add propertyCache to getLogicalView/getAllValuesForAProperty
May 16, 2019
f127b1d
Bug: getAllValues had a NullPointer when PropertyType was null to a
May 16, 2019
0abae9a
Bug: Boolean IndexFields were ignored
May 16, 2019
54fad7a
Bug: OptionalSPARQL had no uuid info
May 16, 2019
83a986f
Bug: The reqeust of invisible properties resulted in Nullpointer
May 16, 2019
ea5e34a
getOptionalSPARQL adapted to index
May 17, 2019
1fb7807
Connect IndexingServiceReader to Rest interface
May 17, 2019
2f91ba3
Bug: Empty rsult of indecing services raised in nullpointer
May 17, 2019
c62c674
configure *.bat and bootstrap
May 17, 2019
dbea57d
Commeted the identity service out.
May 17, 2019
75f3d8d
add getSupportedLanguages
May 17, 2019
70d8216
Bug: Invisible properties resulted in nullpointer for mapping
May 17, 2019
893225e
Bug: OptionalSPARQL created too many rows
May 17, 2019
9a8a182
Bug: wrong language label sent if no language is chosen in UI
May 20, 2019
e41a2e1
Bug: Whitespace in search term resulted in exception
May 20, 2019
c35305d
Bug: Didn't consider to receive null reference of properties by indexing
May 20, 2019
789a53b
Feature: Filter on property which has values + minor bugs
May 20, 2019
413eb37
Bug in slecting the right language for columns
May 20, 2019
c70d57c
delete ubl properties if they have no values in the product
May 21, 2019
071e429
Bug: it was chosen irrelevant properties
May 21, 2019
21eef5e
Bug: detectMeaningOfKeyword couldn't handle whitespace
May 21, 2019
54389bb
Bug: detectMeaningOfKeyword couldn't handle whitespace
May 21, 2019
ad91b7e
Merge branch 'staging' of
May 21, 2019
daeb351
Filter are adapted for indexingService
May 22, 2019
1a8f052
Bug: Values with language labels couldn't filtered
May 22, 2019
157288e
getAllValuesForAGivenProperty has still a bug if too many products are
May 22, 2019
2b408f7
Create Simple Taxonomy Cache (Children, Parents)
May 23, 2019
c1e8598
Search: Chair (parent) and get also Highchairs (child) Items works
May 23, 2019
6d4ea29
workaround for current issue
May 23, 2019
9901ecd
changed labels of default properties
May 23, 2019
a86dd73
add relevance check on standard properties
May 23, 2019
1c8539e
Bug: Description field was estimated as irrelevant
May 24, 2019
16e8248
Bug: detectLanguages fails if no ubl properties are available
Jun 5, 2019
67b1ae5
test method extendes to show the config
Jun 5, 2019
5c2fa08
add config for eco house
Jun 5, 2019
1ea0556
adapt config for eco house
Jun 5, 2019
2c32472
TODO need to add authetifacication
marcofranke Mar 16, 2020
1dbf039
start deleting not used source code
marcofranke Mar 16, 2020
97fdcca
update url of indexing service for eco house
marcofranke Mar 18, 2020
ba3e912
add function to ask the uri of idexing service for testing purpose
marcofranke Mar 18, 2020
2d59551
Try Out: EcoHouse needs an URI adaption
marcofranke Mar 18, 2020
887754c
The try out didn't work
marcofranke Mar 18, 2020
a853dfe
support swedish translation labels + remove not used semantic mediator
marcofranke Mar 19, 2020
ecd3509
I cannot delete libRepo folder. Why
marcofranke Mar 19, 2020
cd12be1
try to delete lib
marcofranke Mar 19, 2020
61e6d45
try again
marcofranke Mar 19, 2020
7d83653
detectmeaning use english label if correct label not available+ delete
marcofranke Mar 20, 2020
1b2ce9e
add authentification token to all rest methods
marcofranke Mar 20, 2020
d0635b7
Add a better description what the search is about
marcofranke Apr 6, 2020
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 11 additions & 19 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,29 +1,21 @@
# Catalog Search Service
Search functionalities are provided by this service. It communicates with the ontological data source, which stores products and user services persistently.
The implemented search mechanism focus on an ontological search. Therefore, it takes all information of an entity into account, which includes its location in a taxonomy as well as all entities’ properties. To enable this, a formalization of the catalogues lies is a precondition and is provided by the indexing service by.

The service can use a local ontology (file) or a Marmotta instance (url) as data source. In each of the cases, a different property must be set.
##Approach:
The goal of this search is to define iteratively in a user driven process which properties of a product or service are relevant for the current search request. Only the selected properties are used to show the user concrete products or services (search result). The explorative behaviour of the search is supported by a graph-based navigation, which allows the iterative exploration of the search space. In so doing, the user learns the available information (product structure and specific instances) for a product/service while he is exploring the search space. Intensional queries are intensively used to support this feature.

In the case of Marmotta, you need the Spring property: nimble.shared.property.marmottauri {any URL}
In the case of local file, you need the Spring property: nimble.shared.property.ontologyfile {abolute path to the file}
In the case of SOLR Index: nimble.shared.property.useSOLRIndex {true | false}

You can run this service as a Docker with the following command (just an example): docker run –p 8050:8080 search-service:0.0.1

In the case of using Marmotta in combinbation with SOLR Index you need the parameters nimble.shared.property.marmottauri and nimble.shared.property.useSOLRIndex

you can run this service as a Docker with the following command (just an example): docker run –p 8050:8080  -e NIMBLE_SHARED_PROPERTY_MARMOTTAURI:http://134.168.33.237:8080/marmotta search-service:0.0.1
##Comment:
The search mechanism using ontologies (file based or accessible by a triple store) and corresponding SPARQL queries are not supported any longer. In the case of interest, please contact: [email protected]


-------------------------------------------------
1. Swagger problem
(1) Das Maven-Plugin kann nicht integriert werden, was nicht weiter schlimm ist. Hier einfach den Fehler in eine Warnung umwandeln.
In Eclipse: "Preferences -> Maven -> Error/Warnings" und Fehler in Warnung umwandeln: "Plugin execution not converted by lifecycle configuration”
(2) Um den von Swagger autogenerierten Quellcode zu Eclipse hinzuzufügen bitte
(a) "mvn clean package” in der Konsole ausführen, um den Quellcode zu generieren. Um "mvn package" richtig auszuführen, die pfad zu owl Datei in "MediatorSPARQLDerivationTest" angepasst werden muss.

(b) Im “Project Explorer” in Eclipse den Ordner “target/generated-sources/swagger/src/gen/java/main” als Source Folder hinzufügen.
(1) The Maven plugin cannot be integrated, which is not a bad thing. Here simply convert the error into a warning.
In Eclipse: "Preferences -> Maven -> Error/Warnings" convert errors in warnings "Plugin execution not converted by lifecycle configuration”
(2) To add the source code generated by Swagger auto to Eclipse please
(a) run "mvn clean package” in a shell to generate sourecode.
(b) Im “Project Explorer” in Eclipse the folder “target/generated-sources/swagger/src/gen/java/main” set the folder as source folder.
-------------------------------------------
2. Debug program
0) update the path within "start.bat"
1) Start "start.bat"
2) You will still need to attach the debugger in Eclipse by making a new Debug Configuration for a "Remote Java Application" on the relevant port.

1 change: 0 additions & 1 deletion getDetectMeaningExample.txt

This file was deleted.

66 changes: 0 additions & 66 deletions getLogicalView_Test_Example.txt

This file was deleted.

2 changes: 0 additions & 2 deletions getPropertiesFromGreenGroupExample.txt

This file was deleted.

Binary file not shown.

This file was deleted.

This file was deleted.

Binary file not shown.

This file was deleted.

Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
<?xml version="1.0" encoding="UTF-8"?>
<metadata>
<groupId>de.biba.mediator</groupId>
<artifactId>de.biba.reasoning.mediator</artifactId>
<versioning>
<versions>
<version>0.0.4-SNAPSHOT</version>
</versions>
<lastUpdated>20170705151324</lastUpdated>
</versioning>
</metadata>
<?xml version="1.0" encoding="UTF-8"?>
<metadata>
<groupId>de.biba.mediator</groupId>
<artifactId>de.biba.reasoning.mediator</artifactId>
<versioning>
<versions>
<version>0.0.4-SNAPSHOT</version>
</versions>
<lastUpdated>20170705151324</lastUpdated>
</versioning>
</metadata>
Binary file not shown.
Binary file not shown.

This file was deleted.

This file was deleted.

Binary file not shown.
Binary file not shown.

This file was deleted.

This file was deleted.

Binary file not shown.

This file was deleted.

This file was deleted.

This file was deleted.

Binary file not shown.

This file was deleted.

This file was deleted.

This file was deleted.

1 change: 0 additions & 1 deletion nimble-anfrae-solr-props.txt

This file was deleted.

47 changes: 11 additions & 36 deletions pom.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
<project xmlns="http://maven.apache.org/POM/4.0.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>

Expand Down Expand Up @@ -95,34 +96,22 @@
<artifactId>spring-boot-starter-tomcat</artifactId>
<version>1.4.2.RELEASE</version><!--$NO-MVN-MAN-VER$ -->
</dependency>




<!-- Mediator dependencies -->


<dependency>
<groupId>org.apache.solr</groupId>
<artifactId>solr-solrj</artifactId>
<version>6.0.0</version>
</dependency>
</dependency>

<dependency>
<groupId>org.apache.marmotta</groupId>
<artifactId>marmotta-client-java</artifactId>
<version>3.3.0</version>
</dependency>

<dependency>
<groupId>de.biba.mediator</groupId>
<artifactId>de.biba.reasoning.mediator</artifactId>
<version>0.0.4-SNAPSHOT</version>
</dependency>
<dependency>
<groupId>de.biba.mediator</groupId>
<artifactId>de.biba.wrapper.xmlwrapper</artifactId>
<version>0.0.1-SNAPSHOT</version>
</dependency>
<!-- <dependency> <groupId>de.biba.mediator</groupId> <artifactId>de.biba.reasoning.mediator</artifactId>
<version>0.0.4-SNAPSHOT</version> </dependency> <dependency> <groupId>de.biba.mediator</groupId>
<artifactId>de.biba.wrapper.xmlwrapper</artifactId> <version>0.0.1-SNAPSHOT</version>
</dependency> -->
<dependency>
<groupId>org.apache.jena</groupId>
<artifactId>jena-arq</artifactId>
Expand All @@ -134,11 +123,8 @@
<version>3.1.0</version>
<type>pom</type>
</dependency>
<dependency>
<groupId>de.biba.mediator</groupId>
<artifactId>de.biba.triple.store.access</artifactId>
<version>0.0.9-SNAPSHOT</version>
</dependency>
<!-- <dependency> <groupId>de.biba.mediator</groupId> <artifactId>de.biba.triple.store.access</artifactId>
<version>0.1.0-SNAPSHOT</version> </dependency> -->
<!-- https://mvnrepository.com/artifact/javax.json/javax.json-api -->
<dependency>
<groupId>org.glassfish</groupId>
Expand All @@ -155,23 +141,12 @@
<artifactId>jdom2</artifactId>
<version>2.0.6</version>
</dependency>
<dependency>
<groupId>de.biba.mediator</groupId>
<artifactId>de.biba.wrapper.xmlwrapper</artifactId>
<version>0.0.1-SNAPSHOT</version>
</dependency>


<dependency>
<groupId>org.mockito</groupId>
<artifactId>mockito-core</artifactId>
<version>2.11.0</version>
</dependency>

<!-- Mujst be clarified why it cannot be imported like the others -->
<!-- <dependency> <groupId>de.biba.mediator</groupId> <artifactId>de.biba.wrapper.simplehttpWrapper</artifactId>
<version>0.0.1-SNAPSHOT</version> <scope>system</scope> <systemPath>${pom.basedir}/lib/de.biba.wrapper.simplehttpWrapper.jar</systemPath>
</dependency> -->

<!--SpringFox dependencies -->
<dependency>
Expand Down
Loading