找到样本数量不一致的输入变量:[24,25]

我需要帮助调整输入内容以匹配输出。我相信我的问题出在我的目标变量上。我收到标题中所述的错误。我尝试了.reshape和.flatten()。请帮助,并预先感谢

NEnews_train = []
for line in open('/Users/db/Desktop/NE1.txt','r'):
    NEnews_train.append(line.strip())



REPLACE_NO_SPACE = re.compile("[.;:!\'?,\"()\[\]]")
REPLACE_WITH_SPACE = re.compile("(<br\s*/><br\s*/>)|(\-)|(\/)")

def preprocess_reviews(reviews):
    reviews = [REPLACE_NO_SPACE.sub("",line.lower()) for line in reviews]
    reviews = [REPLACE_WITH_SPACE.sub(" ",line) for line in reviews]


    return reviews

NE_train_clean = preprocess_reviews(NEnews_train)

from nltk.corpus import stopwords

english_stop_words = stopwords.words('english')
def remove_stop_words(corpus):
    removed_stop_words = []
    for review in corpus:
        removed_stop_words.append(
            ' '.join([word for word in review.split() 
                      if word not in english_stop_words])
        )
    return removed_stop_words

no_stop_words = remove_stop_words(NE_train_clean)



ngram_vectorizer = CountVectorizer(binary=True,ngram_range=(1,2))
ngram_vectorizer.fit(no_stop_words)
X = ngram_vectorizer.transform(no_stop_words)
X_test = ngram_vectorizer.transform(no_stop_words)

target = [1 if i < 12 else 0 for i in range(25)]

X_train,X_val,y_train,y_val = train_test_split(
    X,target,train_size = 0.75
)

这是错误

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-14-281ec07b46bb> in <module>
      2 
      3 X_train,y_val = train_test_split(
----> 4     X,train_size = 0.75
      5 )

~/opt/anaconda3/lib/python3.7/site-packages/sklearn/model_selection/_split.py in train_test_split(*arrays,**options)
   2094         raise TypeError("Invalid parameters passed: %s" % str(options))
   2095 
-> 2096     arrays = indexable(*arrays)
   2097 
   2098     n_samples = _num_samples(arrays[0])

~/opt/anaconda3/lib/python3.7/site-packages/sklearn/utils/validation.py in indexable(*iterables)
    228         else:
    229             result.append(np.array(X))
--> 230     check_consistent_length(*result)
    231     return result
    232 

~/opt/anaconda3/lib/python3.7/site-packages/sklearn/utils/validation.py in check_consistent_length(*arrays)
    203     if len(uniques) > 1:
    204         raise ValueError("Found input variables with inconsistent numbers of"
--> 205                          " samples: %r" % [int(l) for l in lengths])
    206 
    207 

ValueError: Found input variables with inconsistent numbers of samples: [24,25]

我看到人们有相似的错误,但是他们的代码与我的有所不同,所以我在尝试解决时有些困惑

abiaoa 回答:找到样本数量不一致的输入变量:[24,25]

在您的SELECT px1.tbl.value('@name','nvarchar(50)') as TableName,px2.col.value('@name','nvarchar(50)') as ColName from #testXML px cross apply inputxml.nodes ('/document/table') as px1(tbl) cross apply inputxml.nodes ('/document/table/column') as px2(col) 列表中,项目总数为X。但是,在您的24数组中,您采用的是target值(因为25返回了一个range(25)总共25个值(不包括[0,1,2,...,24]的数组),这就是{{ 1}}出现上述错误,因为25要求train_test_split为真。

解决方案:

train_test_split

如果要从X.shape[0] == target.shape[0]到`25(included)``

开始,请使用以下代码更改上面的代码。

target = [1 if i < 12 else 0 for i in range(25)]

或者,如果您想从1target = [1 if i < 12 else 0 for i in range(1,26)],那么

0

本文链接:https://www.f2er.com/3079356.html

大家都在问