[Solved] comparing two text file and find out the related word in python

by

Introduction

This tutorial will provide a step-by-step guide on how to compare two text files and find out the related words in Python. We will use the Python library NLTK (Natural Language Toolkit) to compare the two files and extract the related words. We will also discuss the various methods available to compare the two files and the advantages and disadvantages of each. Finally, we will provide some tips and tricks to make the comparison process easier and more efficient.

Solution

#importing the necessary libraries
import difflib

#opening the two text files
file1 = open(“file1.txt”, “r”)
file2 = open(“file2.txt”, “r”)

#reading the content of the two files
text1 = file1.read()
text2 = file2.read()

#closing the two files
file1.close()
file2.close()

#creating a difflib object
diff = difflib.Differ()

#comparing the two files and finding the related words
difference = diff.compare(text1.split(), text2.split())

#printing the related words
for line in difference:
if line[0] == ‘+’:
print(line[2:])


While it is still unclear what you mean by a “partial query”, the code below can do that, simply by you redefining a partial query in the function filter_out_common_queries. E.g. if you are looking for an exact match of the query in search.txt, you could replace # add your logic here by return [' '.join(querylist), ].

import datetime as dt
from collections import defaultdict

def filter_out_common_queries(querylist):
    # add your logic here
    return querylist

queries_time = defaultdict(list)  # personally, I'd use 'set' as the default factory
with open('log.txt') as f:
    for line in f:
        fields = [ x.strip() for x in line.split(',') ]
        timestamp = dt.datetime.strptime(fields[0], "%H:%M:%S")
        queries_time[fields[1]].append(timestamp)  

with open('search.txt') as inputf, open('search_output.txt', 'w') as outputf:
    for line in inputf:
        fields = [ x.strip() for x in line.split(',') ]
        timestamp = dt.datetime.strptime(fields[0], "%H:%M:%S")
        queries = filter_out_common_queries(fields[1].split())  # "adidas watches for men" -> "adidas" "watches" "for" "men". "for" is a very generic keyword. You should do well to filter these out
        results = []
        for q in queries:
            poss_timestamps = queries_time[q]
            for ts in poss_timestamps:
                if timestamp - dt.timedelta(seconds=15) <= ts <= timestamp:
                    results.append(q)
        outputf.write(line.strip() + " - {}\n".format(results))

Output based on your input data:

19:00:15  , mouse , FALSE - []
19:00:15  , branded luggage bags and trolley , TRUE - []
19:00:15  , Leather shoes for men , FALSE - []
19:00:15  , printers , TRUE - []
19:00:16  , adidas watches for men , TRUE - ['adidas', 'adidas', 'adidas', 'adidas', 'adidas', 'adidas']
19:00:16  , Mobile Charger Stand/Holder black , FALSE - ['black']
19:00:16  , watches for men , TRUE - []

Remark that a match for ‘black’ in “Mobile Charger Stand/Holder black” was found. That’s because in the code above, I looked for each separate word in itself.

Edit: To implement your comment, you would redefine filter_out_common_queries like so:

def filter_out_common_queries(querylist):
    basequery = ' '.join(querylist)
    querylist = []
    for n in range(2,len(basequery)+1):
        querylist.append(basequery[:n])
    return querylist

3

solved comparing two text file and find out the related word in python


Comparing two text files and finding related words in Python can be a daunting task. However, with the right tools and techniques, it can be done quickly and easily. In this article, we will discuss how to compare two text files and find related words in Python.

The first step in comparing two text files is to read the files into memory. This can be done using the open() function in Python. The open() function takes two arguments: the file name and the mode. The mode argument can be either ‘r’ for reading or ‘w’ for writing. Once the files are read into memory, they can be compared using the difflib library.

The difflib library provides a number of functions for comparing two text files. The most commonly used function is the difflib.SequenceMatcher() function. This function takes two strings as arguments and returns a list of tuples containing the differences between the two strings. The tuples contain the start and end indices of the differences, as well as the type of difference (insertion, deletion, or substitution).

Once the differences between the two strings have been identified, the next step is to find related words. This can be done using the difflib.get_close_matches() function. This function takes two arguments: the word to be matched and a list of words to compare it to. It then returns a list of words that are similar to the word being matched. This list can then be used to identify related words in the two text files.

Comparing two text files and finding related words in Python is a relatively simple task. With the right tools and techniques, it can be done quickly and easily. By using the difflib library and the get_close_matches() function, it is possible to quickly and accurately identify related words in two text files.