Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Research: Evaluation Metrics for Knowledge Graphs #40

Open
debrupf2946 opened this issue Sep 23, 2024 · 0 comments
Open

Research: Evaluation Metrics for Knowledge Graphs #40

debrupf2946 opened this issue Sep 23, 2024 · 0 comments

Comments

@debrupf2946
Copy link
Collaborator

Proposal for Integration of Evaluation Metrics for Knowledge Graphs

Description

To ensure the quality and effectiveness of our knowledge graphs, it is crucial to evaluate their construction using appropriate metrics. This issue aims to invite contributors to propose evaluation metrics that can be integrated into our project.

Objective

  • Research and identify evaluation metrics for knowledge graphs.
  • Submit a proposal for integrating a specific metric, ensuring it has not already been taken by other contributors.
  • Provide a clear review of the metric, including:
    • What it measures: Briefly describe the metric and its significance.
    • How it measures: Explain the methodology or approach used by the metric.
    • Implementation notes: Any relevant insights or considerations for implementing this metric in our project.

Suggested Research Papers

To get started, you may refer to the following research papers that discuss various metrics for knowledge graph evaluation:

  1. Evaluating Knowledge Graphs using Triple Classification
  2. Exploring Metrics for Knowledge Graph Quality Assessment

Feel free to explore additional resources and literature to identify other relevant metrics.

Submission Guidelines

  1. Create a new issue with the proposal for your selected metric, referencing this issue.
  2. Ensure the metric has not been claimed by checking existing proposals.
  3. Provide a detailed review, including the metric's purpose, evaluation approach, and any implementation considerations.

We look forward to your contributions and insights to enhance our knowledge graph evaluation process!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant