How big is too big for a DistributedCache file hadoop? -


are there guidelines whether distribute file using distributed cache or not ?

i have file of size 86746785 (i use hadoop dfs -dus - don't know if in bytes or what). idea distribue file ?

the viable answer "it depends".

what have consider using distributed cache file gets copied every node involved in task, takes bandwidth. also, if want file in distributed cache, you'll keep file in memory, you'd have take consideration.

as case -- yes, bytes. size 86 mb, fine distributed cache. within couple hundred mbs should still be.


Comments

Post a Comment

Popular posts from this blog

asp.net mvc 3 - Using mvc3, I need to add a username/password to the sql connection string at runtime -

i see how build string using stringbuilders (sql/entity framework); do cause connection string used in dbcontext? example context: public class pophistorydbcontext : dbcontext { public dbset<pophistory> histories {get;set} } public class pophistoryrepository: ihistoryrepository { private pophistorydbcontext context = new pophistorydbcontext(); public iqueryable<pophistory> histories{ {return context.histories;} } } example usage in controller: public class historycontroller : controller { private ihistoryrepository repository = new pophistoryrepository(); var histories = h in repository.histories (h.modifytimestamp > today) select h; if (!string.isnullorempty(searchstring)) { histories = histories.where(h => h.dn.toupper().contains(searchstring.toupper())); } thank you
Read more

kineticjs - draw multiple lines and delete individual line -

i can draw multiple lines on canvas; added layer using drawscene dlayera1.add(line); line.getpoints()[0].x = mousepos.x; line.getpoints()[0].y = mousepos.y; line.getpoints()[1].x = mousepos.x; line.getpoints()[1].y = mousepos.y; moving = true; dlayera1.drawscene(); http://jsfiddle.net/user373721/xzead/1/ . is there way delete individual line? currently, you'll have modify points array this: line.getpoints()[0].splice(index, 1); since arrays modified reference, modifying returned array modifies "source of truth" points array attr
Read more

thumbnails - jQuery image rotate on hover -

any chance change image src on hover , count 10 , again first? this need, default thumb, flv-3.jpg ! <img src="/thumbs/e/b/d/6/d/ebd6d2d6d99e/ebd6d2d6d99e.flv-3.jpg" /> on mouse hover need change number flv-1.jpg flv-2.jpg flv-3.jpg flv-4.jpg etc.. up 10, , again , start number 1, when move mouse thumbs need default thumb flv-3.jpg this im use not solutions, var _thumbs = new array(); function changethumb(index, i, num_thumbs, path) { if (_thumbs[index]) { document.getelementbyid(index).src = path + + ".jpg"; preload = new image(); preload_image_id = (i + 1 > num_thumbs) ? 1 : + 1; preload.src = path + preload_image_id + ".jpg"; = % num_thumbs; i++; settimeout("changethumb('" + index + "'," + + ", " + num_thumbs + ", '" + path + "')", 800) } } function startthumbchange(index, nu
Read more