I have a column daycount list<BigInt>. The column is storing a count.
Every few secs a new count is appended. The total count for the day is the
sum of all items in the list.
My application logs indicate I wrote about 110000 items to the column for a
particular row. Assume row key is day_timestamp.
But when I do a read on the column I get back a list with only 43000 items.
Checked with both java driver and CQL.
There are no errors or exceptions anywhere.
There is this statement in the WIKI "Collection values may not be larger
than 64K". I assume this refers to 1 item in a collection.
Has anyone else seen an issue like this ?
Manoj Khangaonkar 's gravatar image asked Jan 22 2014 at 18:17 in Cassandra-User by Manoj Khangaonkar

2 Answers

Thanks. I guess I can work around by maintaining hour_counts (which will
have fewer items) and adding the hour counts to
get day counts.
Manoj Khangaonkar 's gravatar image answered Jan 22 2014 at 19:28 by Manoj Khangaonkar
Alternatively you can use clustering columns to store very big collections.
Beware of not making a row too wide though (use bucketing)
Le 23 janv. 2014 04:29, "Manoj Khangaonkar" a crit
DuyHai Doan 's gravatar image answered Jan 23 2014 at 11:29 by DuyHai Doan

Related Discussions

  • Collection Type Column in Cassandra-user

  • Hi, I understand that collection type column are supported via cql3 only. Can anybody please share how actually such mutations happen? I can see that actual column value is clubbed with column name in form of a ColumnGroupMap(type Collection). But not able to identify how it works internally within Cassandra? Any thoughts? -Vivek...

  • Create Index On Column Of User Defined Type? in Cassandra-user

  • Although I have not seen any documentation that says one cannot do this, version 2.1.2 is complaining about defining one. CREATE TYPE wdm.thing ( thing_name text, ... CREATE TABLE wdm.ctins ( foo_no text, item frozen, ... CREATE INDEX foo ON wdm.gtins(item.thing_name); Is there something...

  • Is There Any Type Of Table Existing On All Nodes(slow To Up Date, Fast To Read In Map/reduce)? in Cassandra-user

  • I was just wondering if cassandra had any special CF that every row exists on every node for smaller tables that we would want to leverage in map/reduce. The table row count is less than 500k and we are ok with slow updates to the table, but this would make M/R blazingly fast since for every row, we read into this table. Thanks, Dean...

  • Revisit With Another Spin: Is There Any Type Of Table Existing On All Nodes? in Cassandra-user

  • The meta information stored on behalf of CQL must exist on all nodes and must update all nodes as well. What table type is that meta information stored in? And is it possible we can use that same type of table? After all, this makes M/R blazingly fast to do local lookups in the database (and we just have additional meta information that is used by all rows). Are any of the meta tables writeable...

  • Changing The Primary Key Type Of A Table in Cassandra-user

  • hi, we have a table that its primary key is uuid type. Now we decide that we need to use text type as it is more flexible for our application. #1 is there any downside using text as primary key? any performance impact on the partition ? #2 There is no way to alter a table's primary key with a cql command, that is what i have read, migrating to a new table seems to be the only way. Is ...

  • Is It Possible To Have A Column Which Can Hold Any Data Type (for Inserting As Json) in Cassandra-user

  • Hi, I have a json data as shown below. { "address":"", "datatype":"DOUBLE", "name":"Longitude", "attributes":{ "Id":"1" }, "category":"REAL", "...

  • Cassandra: Maximum Size Of Collection List Type in Cassandra-user

  • Hi, What is the maximum size which can be stored into collection list(in a row ) in cassandra. -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"...

  • COPY FROM On Counters in Cassandra-user

  • Is there a way to use COPY FROM on a column family with a counter type column ? -- Marco Matarazzo == Hex Keep == W: http://www.hexkeep.com M: +39 347 8798528 E: [email protected] "You can learn more about a man in one hour of play than in one year of conversation.” - Plato...

  • Doing An Upsert Into A Collection? in Cassandra-user

  • Say I have this UDT: *CREATE TYPE rating (* * user text,* * rating int* *);* And, I have this table: *CREATE TABLE movie (* * id text,* * name text,* * ratings list,* * PRIMARY KEY ( id )* *);* Say a user 'bob' rated a movie as a 5. Is it possible to do something like this: *UPDATE movie set ratings.rating = 5 WHERE ratings.user = 'bob'* And have that query either update...

  • Bad Request: Type Error: Cannot Assign Result Of Function Token (type Bigint) To Id (type Int) in Cassandra-user

  • I'm building a new schema which I need to read externally by paging through the result set. My understanding from reading the documentation , and this list, is that I can do that but I need to use the token() function. Here's a reduction: create table test_paging ( id int, primary key(id) ); insert into test_paging (id) values (1); insert into test_paging (id) values (2); insert...

  • Read Performance In Map Data Type in Cassandra-user

  • Hello All, We've a schema which can be modeled as (studentID, subjectID, marks) where combination of studentID and subjectID is unique. Number of studentID can go up to 100 million and for each studentID we can have up to 10k subjectIDs. We are using apahce cassandra 2.0.4 and datastax java driver 1.0.4. We are using a four node cluster, each having 24 cores and 32GB memory. I'm sure that...

  • Filter Using Timeuuid Column Type in Cassandra-user

  • Hi, Is it possible to filter records by using timeuuid column types in case the column is not part of the primary key? I tried the followings: [cqlsh 3.1.2 | Cassandra | CQL spec 3.0.0 | Thrift protocol 19.36.0] CREATE TABLE timeuuid_test2( row_key text, time timeuuid, time2 timeuuid, message text, PRIMARY KEY (row_key, time) ) Cqlsh: select * from timeuuid_test2 where...


  • hii.. can some body please tell me how to select a column of type int or float and print that column value in cassandra mapreduce? every thing I read is about reading a String column form cassandra and print the values.....

  • Frozen Type Sin Cassandra. in Cassandra-user

  • Hi, Is there is difference between creating column of type frozen and frozen where list_double is UDT of type frozen ? Also how to create a solr index on such columns?...

  • Unable To Create Collection Inside Collection in Cassandra-user

  • Hi, I am not able to create collection inside another collection in Cassandra. Please find screenshot below [cid:[email protected]] In the above screenshot, I am trying to create column named feeschedule with type Map and Map have values which is of type List. Could anybody suggest me how do I achieve it in Cassandra. My Cassandra version details are given below: cqlsh...

  • Partition Key Of Composite Type And "where Partition_key In (...)" Clause in Cassandra-user

  • Hello, Is it possible to use the "where partition_key in (...)" clause if the partition key has a composite type? I have a schema as follows: create table tbl ( k1 int, k2 varchar, k3 varchar, m blob, primary key((k1, k2), k3) ) I would like to be able to do something like select m from tbl where (k1, k2) in ((0, 'abc'), (1, 'xyz')); I think though that...

  • Deserialize The Collection Type Data From The SSTable File in Cassandra-user

  • Hi, Cassandra users: I have a question related to how to Deserialize the new collection types data in the Cassandra 2.x. (The exactly version is C 2.0.10). I create the following example tables in the CQLSH: CREATE TABLE coupon ( account_id bigint, campaign_id uuid, ........................, discount_info map, ........................, PRIMARY KEY (account_id, campaign_id)) The other columns...

  • Deserialize The Collection Type Data From The SSTable File in Cassandra-user

  • Hi, Cassandra users: I have a question related to how to Deserialize the new collection types data in the Cassandra 2.x. (The exactly version is C 2.0.10). I create the following example tables in the CQLSH: CREATE TABLE coupon ( account_id bigint, campaign_id uuid, ........................, discount_info map, ........................, PRIMARY KEY (account_id, campaign_id)) The other columns...

  • Fixed Size Collection Possible? in Cassandra-user

  • hi, look at the collection type support in cql3, e.g http://www.datastax.com/documentation/cql/3.0/cql/cql_using/use_list_t.html we can append or remove using "+" and "-" operator UPDATE users SET top_places = top_places + [ 'mordor' ] WHERE user_id = 'frodo'; UPDATE users SET top_places = top_places - ['riddermark'] WHERE user_id = 'frodo'; is there a way to keep a fixed size of...

  • Read/Write Consistency Issue in Cassandra-user

  • Hi Using Cassandra 2.0.0. 3 node cluster Replication 2. Using consistency ALL for both read and writes. I have a single thread that reads a value, updates it and writes it back to the table. The column type is big int. Updating counts for a timestamp. With single thread and consistency ALL , I expect no lost updates. But as seem from my application log below, 10 07:01:58,507 [Thread...