Antonis Krasakis's Avatar

Antonis Krasakis

@tonylittlewine

PhD student at University of Amsterdam. Working on information retrieval, LLMs and RAG

77
Followers
94
Following
7
Posts
19.11.2024
Joined
Posts Following

Latest posts by Antonis Krasakis @tonylittlewine

Thanks for sharing! Are there any positions that do not require a US work permit (or remote possibility)?

18.01.2025 12:25 πŸ‘ 0 πŸ” 0 πŸ’¬ 2 πŸ“Œ 0

I'm excited about this line of work, as it paves the way towards more effective and lexically grounded representations for complex queries!
Many thanks to my co-authors for their support and constructive feedback!
#IR #NLP #research

15.01.2025 11:57 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

To do so, we introduce a novel activation function (SNReLU) that preserves the desirable properties of splade models (log saturation effect, sparsity). We find that, given enough training data (needed to adapt to the new act fn), retrieval performance for negations improves by +100%!

15.01.2025 11:57 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Finally, we focus on negations, a challenging yet under-explored area in IR. The main idea is simple: we allow LSR models attribute negative term scores to terms associated with negated aspects of the query. In practice this allows LSR models to directly penalize documents containing negated aspects

15.01.2025 11:57 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

First, we construct zero-shot representations
using vector arethmetics designed to encapsulate each compositionality type (eg. intersection or negations). This method often outperforms DR/LSR models trained for compositionality, which struggle for some of these compositionality types

15.01.2025 11:57 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Preview
Constructing Set-Compositional and Negated Representations for First-Stage Ranking Set compositional and negated queries are crucial for expressing complex information needs and enable the discovery of niche items like Books about non-European monarchs. Despite the recent advances i...

I'm super excited to share the last paper of my PhD! It investigates how to construct representations for negated and set-compositional queries, using Learned Sparse Retrievers. LSR representations are compelling, as they are lexically grounded and can be easily manipulated.
arxiv.org/abs/2501.07679

15.01.2025 11:57 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Supporting immigration but only for skilled or highly paid workers isn’t as progressive as some people seem to think

28.12.2024 15:40 πŸ‘ 112 πŸ” 25 πŸ’¬ 4 πŸ“Œ 1

I'd like to be added too!

24.11.2024 09:54 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0