Natural Language Processing questions and answers
Tokenisation, embeddings, language models and text pipelines. Page 8 of 9.
ML System Design practice on Codemia
Design recommenders, ranking systems and training pipelines the way ML interviews actually ask for them, with worked solutions.
Answers 421-480
- Use WEKA API to perform LSA on train and test set
- Using a pre-trained word embedding word2vec or Glove in TensorFlow
- Using BERT for next sentence prediction
- Using celery to process huge text files
- Using keras tokenizer for new words not in training set
- Using NLTK/NaiveBayesClassifier, always getting ''Positive'' output on test data
- Using pre-trained word2vec with LSTM for word generation
- Using Syntaxnet with TensorFlow Serving
- Using word2vec to classify words in categories
- UTF-8 all the way through
- u'ufeff' in Python string
- Variation in BLEU \`Score\`
- Visualize Gensim Word2vec Embeddings in Tensorboard Projector
- Vocabulary Processor function
- what actually word embedding dimensions values represent?
- What algorithm can you use to find duplicate phrases in a string?
- What algorithm gives suggestions in a spell checker?
- What are all possible POS tags of NLTK?
- What are some algorithms for comparing how similar two strings are?
- What are the differences between contextual embedding and word embedding
- What are the major differences and benefits of Porter and Lancaster Stemming algorithms?
- What does a weighted word embedding mean?
- What does Keras Tokenizer num_words specify?
- What does Keras Tokenizer num_words specify?
- What does langchain CharacterTextSplitter's chunk_size param even do?
- What does tf.nn.embedding_lookup function do?
- What does the Brown clustering algorithm output mean?
- What does the default sklearn TfidfVectorizer preprocessor do?
- what does the vector of a word in word2vec represents?
- What is a term-vector algorithm?
- What is the best way to remove accents normalize in a Python unicode string?
- What is the concept of negative-sampling in word2vec?
- What is the difference between an Embedding Layer and a Dense Layer?
- what is the difference between bigram and unigram text features extraction
- What is the difference between keras.tokenize.text_to_sequences and word embeddings
- What is the good metric to evaluate NER model trained in Spacy
- What is the network structure inside a Tensorflow Embedding Layer?
- What is the preferred ratio between the vocabulary size and embedding dimension?
- What is the purpose of weights and biases in tensorflow word2vec example?
- What is UNK Token in Vector Representation of Words
- What to do when Seq2Seq network repeats words over and over in output?
- What to do when Seq2Seq network repeats words over and over in output?
- What's the alternative for TensorFlow VocabularyProcessor?
- What's the major difference between glove and word2vec?
- Where do dimensions in Word2Vec come from?
- Where is the source to embedding-projector-standalone?
- Which classification algorithm can be used for document categorization?
- Which model/technique to use for specific sentence extraction?
- Why are these words considered stopwords?
- Why Bert transformer uses CLS token for classification instead of average over all tokens?
- Why Bert transformer uses CLS token for classification instead of average over all tokens?
- Why can we use entropy to measure the quality of language model?
- Why does embedding vector multiplied by a constant in Transformer model?
- Why does word2vec use 2 representations for each word?
- Why is embedding_lookup better than one hot encoding with a linear transformation?
- Why is the length of this string longer than the number of characters in it?
- Wit.ai recognizes numbers as location
- Word-level edit distance of a sentence
- word2vec - get nearest words
- Word2Vec Number of Dimensions
.png&w=3840&q=75)
Free course
Beginner
7 lessons
2 hours
Tackling System Design Interview Problems
A short course that equips you with the skills to approach system design interviews methodically.
Start the free course